Expected Behavior
when using BigQuery Batch source with the given query instead of table name, I suppose the schema would be inferred internally by executing jobs on billing project id (if provided).
Current Behavior
The inference job is running on the attached project id with the current service account even when I provided specific billing project id.
Steps to reproduce
- Prepare a repo with provided billing project id (named A) which is different from the attached one (named B).
- Create a BigQuerySource with query statements.
feast apply
- Now check where the job running -> it's B
Specifications
- Version: 0.27.1
- Platform: Linux
- Subsystem: Ubuntu
Possible Solution
a few changes needed here line 162