Skip to content

feat: manifest onboarding - #2

Closed
gaurpulkit wants to merge 2 commits into
mainfrom
dbt-manifest-onboard
Closed

feat: manifest onboarding#2
gaurpulkit wants to merge 2 commits into
mainfrom
dbt-manifest-onboard

Conversation

@gaurpulkit

Copy link
Copy Markdown
Contributor

No description provided.

Comment thread src/datapilot/cli/main.py Outdated
@click.option("--tenant", prompt="Tenant", help="Your tenant ID.")
@click.option("--dbt_core_integration_id", prompt="DBT Core Integration ID", help="DBT Core Integration ID")
@click.option("--manifest-path", prompt="Manifest Path", help="Path to the manifest file.")
def onboard(token, tenant, dbt_core_integration_id, manifest_path, env):

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should go to the dbt cli.py

Comment thread src/datapilot/cli/main.py Outdated
token = os.environ.get("DBT_API_TOKEN")

if not token or not tenant:
print("Error: API Token is required.")

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

click.echo()

Comment thread src/datapilot/cli/main.py Outdated
def onboard(token, tenant, dbt_core_integration_id, manifest_path, env):
"""Onboard a manifest file to DBT."""
if not token and env:
token = os.environ.get("DBT_API_TOKEN")

@suryaiyer95 suryaiyer95 Jan 26, 2024

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ALTIMATE_API_KEY

ALTIMAT_INSTANCE_NAME

Comment thread src/datapilot/clients/altimate/client.py
Comment thread src/datapilot/utils/utils.py Outdated
with open(manifest_path, "rb") as file:
file_content = file.read()

upload_response = api_client.post(signed_url, data=file_content)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe this can be a util

load_cpntent_to_signed_url()

headers = self._get_headers()

self.logger.debug(f"Sending GET request for tenant {self.tenant} at url: {url}")
print(f"Sending GET request for tenant {self.tenant} at url: {url}")

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't use prints

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prints are the only thing that are appearing in my terminal. logger.debug isn't showing up at all

click.echo("Error: API Token is required.")
return

# if not validate_credentials(token, tenant):

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any reason?

@suryaiyer95

Copy link
Copy Markdown
Collaborator

stale and not needed.

Sourabhchrs93 added a commit that referenced this pull request Jul 22, 2026
…-v5 parsers (#108)

Mirror of the v6 `Status` shim (AI-7435, PR #106) for the pre-v6 schemas,
closing the residual of AI-7675 finding #2: any run status outside
`success`/`error`/`skipped` (e.g. dbt 2.0 `reused`, or any future status)
raised a `ValidationError` in run_results v1-v5 and the ingestion worker
silently dropped the entire `run_results.json`.

- Make `Status` a `str, Enum`, add `reused`, and add the `_missing_`
  forward-compat fallback so unknown statuses surface as real members
  instead of failing validation (identical to the v6 fix).
- Reorder `RunResultOutput.status` to `Union[Status1, Status2, Status]`
  so test/freshness statuses (`pass`/`fail`/`warn`/`runtime error`) keep
  resolving via the strict enums and the permissive run `Status` is tried
  last (same reordering as v6).
- Add parameterized regression tests over v1-v5 mirroring
  `test_run_results_v6.py`, including full-file `parse_run_results`.

Freshness-specific enums (`Status3`/`Status4` in v3/v4) are untouched,
matching the v6 fix scope.

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants