brainy-tent-14503
02/08/2024, 4:52 PMbillions-butcher-90660
02/08/2024, 4:56 PMcareful-painting-49661
02/08/2024, 4:57 PMlittle-megabyte-1074
dazzling-judge-80093
02/08/2024, 5:04 PMbrainy-tent-14503
02/08/2024, 5:05 PMbland-receptionist-85001
02/08/2024, 5:18 PMbland-balloon-48379
02/08/2024, 5:19 PMSource (sqlalchemy) report:
{'events_produced': 697,
'events_produced_per_sec': 30,
'entities': {'container': ['<example urns>'],
'dataset': ['<example urns>',
'... sampled of 114 total elements']},
'aspects': {'container': {'containerProperties': 2, 'status': 2, 'dataPlatformInstance': 2, 'subTypes': 2, 'browsePathsV2': 4, 'container': 1},
'dataset': {'container': 114,
'status': 114,
'datasetProperties': 114,
'schemaMetadata': 114,
'dataPlatformInstance': 114,
'subTypes': 114,
'browsePathsV2': 228}},
'warnings': {},
'failures': {},
'soft_deleted_stale_entities': [],
'tables_scanned': 134,
'views_scanned': 0,
'entities_profiled': 0,
'filtered': ['<example filtered schemas>',
'... sampled of 261 total elements'],
'num_view_definitions_parsed': 0,
'num_view_definitions_failed_parsing': 0,
'num_view_definitions_failed_column_parsing': 0,
'view_definitions_parsing_failures': [],
'start_time': '2024-02-08 17:06:44.703672 (22.5 seconds ago)',
'running_time': '22.5 seconds'}
some-alligator-9844
02/08/2024, 5:27 PMsome-alligator-9844
02/08/2024, 5:28 PMTraceback (most recent call last):
File "/data/vdc/conda/condapub/svc_am_cicd/envs/dh-actions/bin/datahub-actions", line 5, in <module>
from datahub_actions.entrypoints import main
File "/data/vdc/conda/condapub/svc_am_cicd/envs/dh-actions/lib/python3.10/site-packages/datahub_actions/entrypoints.py", line 21, in <module>
from datahub.cli.cli_utils import get_boolean_env_variable
ImportError: cannot import name 'get_boolean_env_variable' from 'datahub.cli.cli_utils' (/data/vdc/conda/condapub/svc_am_cicd/envs/dh-actions/lib/python3.10/site-packages/datahub/cli/cli_utils.py)
early-account-74529
02/08/2024, 5:42 PMloud-rose-15723
02/08/2024, 5:57 PMbillions-butcher-90660
02/08/2024, 6:42 PMbrainy-tent-14503
02/08/2024, 6:49 PMbulky-shoe-65107
02/09/2024, 3:02 PMlittle-megabyte-1074
some-alligator-9844
03/07/2024, 1:46 PMincalculable-sundown-8765
03/07/2024, 2:22 PMdatahub delete
. I want to hard delete everything related to redshift.
However, I encounter this issue:
% datahub delete --platform redshift --dry-run
[2024-03-06 20:13:35,266] INFO {datahub.cli.delete_cli:341} - Using DataHubGraph: configured to talk to <http://localhost:8080>
[2024-03-06 20:13:36,009] ERROR {datahub.entrypoints:201} - Command failed: ('Unable to get metadata from DataHub', {'message': '401 Client Error: Unauthorized for url: <http://localhost:8080/api/graphql'}>)
Do I need token to run the command? If so, how can I include the token in the command?
Thank you.
Datahub version: v0.12.1careful-painting-49661
03/07/2024, 2:27 PMlittle-megabyte-1074
early-librarian-13786
03/07/2024, 3:07 PMbrainy-tent-14503
03/07/2024, 3:54 PMminiature-train-5342
03/07/2024, 4:55 PMlittle-megabyte-1074
icy-airplane-5350
03/07/2024, 6:00 PMdry-raincoat-85182
03/07/2024, 6:07 PMeager-school-14258
03/07/2024, 6:38 PMboundless-bear-68728
03/08/2024, 5:15 PM'The above exception was the direct cause of the following exception:\n'
'\n'
'Traceback (most recent call last):\n'
' File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
' task_event_loop.run_until_complete(task_future)\n'
' File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
' return future.result()\n'
' File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 214, in execute\n'
" raise RuntimeError(f'Something went wrong in the subprocess executor: {e}') from e\n"
"RuntimeError: Something went wrong in the subprocess executor: ('Unable to emit metadata to DataHub GMS', {'message': "
"'HTTPConnectionPool(host=\\'datahub-datahub-gms\\', port=8080): Max retries exceeded with url: /aspects?action=ingestProposal (Caused by "
'ReadTimeoutError("HTTPConnectionPool(host=\\\'datahub-datahub-gms\\\', port=8080): Read timed out. (read timeout=30)"))