[2022/04/18-04:35:32.172] [ActivityExecutor-29] [INFO] [dku] running compute_dataset_output_NP - ---------------------------------------- [2022/04/18-04:35:32.172] [ActivityExecutor-29] [INFO] [dku] running compute_dataset_output_NP - DSS startup: jek version:10.0.5 [2022/04/18-04:35:32.172] [ActivityExecutor-29] [INFO] [dku] running compute_dataset_output_NP - DSS home: /home/vinayak_satapute/dss_data [2022/04/18-04:35:32.172] [ActivityExecutor-29] [INFO] [dku] running compute_dataset_output_NP - OS: Linux 3.10.0-1160.59.1.el7.x86_64 amd64 - Java: Red Hat, Inc. 1.8.0_322 [2022/04/18-04:35:32.171] [ActivityExecutor-29] [INFO] [dku.flow.jobrunner] running compute_dataset_output_NP - Allocated a slot for this activity! [2022/04/18-04:35:32.172] [ActivityExecutor-29] [INFO] [dku.flow.jobrunner] running compute_dataset_output_NP - Run activity [2022/04/18-04:35:32.191] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Executing default pre-activity lifecycle hook [2022/04/18-04:35:32.205] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Checking if sources are ready [2022/04/18-04:35:32.239] [ActivityExecutor-29] [INFO] [dku.datasets.gcs] running compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"TShirts","connection":"GCS_Connection","path":"/candidate-apac-vsatapute/TShirts/orders.csv","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":["orders.csv"]}} [2022/04/18-04:35:32.241] [ActivityExecutor-29] [INFO] [dku.datasets.bloblike] running compute_dataset_output_NP - Enumerating Filesystem dataset prefix= [2022/04/18-04:35:32.269] [ActivityExecutor-29] [INFO] [dku.fsproviders.google] running compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts/orders.csv (connectionChroot=) [2022/04/18-04:35:32.353] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:32.356] [ActivityExecutor-29] [INFO] [dku.utils.googlecloud] running compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:32.399] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:32.843] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:32.844] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Listing first items [2022/04/18-04:35:32.844] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:32.845] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:32.874] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:32.875] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:32.904] [ActivityExecutor-29] [INFO] [dku.fsproviders.google] running compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts (connectionChroot=) [2022/04/18-04:35:32.906] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:32.907] [ActivityExecutor-29] [INFO] [dku.utils.googlecloud] running compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:32.907] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:32.963] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:32.963] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Listing first items [2022/04/18-04:35:32.964] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:32.964] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:32.994] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:32.994] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:32.996] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Checked source readiness DATAIKUTSHIRTS.TShirts -> true [2022/04/18-04:35:32.997] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Computing hashes to propagate BEFORE activity [2022/04/18-04:35:32.997] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Recorded 1 hashes before activity run [2022/04/18-04:35:32.998] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Building recipe runner of type [2022/04/18-04:35:33.009] [ActivityExecutor-29] [DEBUG] [dku.job.activity] running compute_dataset_output_NP - Filling source sizes [2022/04/18-04:35:33.013] [ActivityExecutor-29] [INFO] [dku.datasets.gcs] running compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"TShirts","connection":"GCS_Connection","path":"/candidate-apac-vsatapute/TShirts/orders.csv","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":["orders.csv"]}} [2022/04/18-04:35:33.014] [ActivityExecutor-29] [INFO] [dku.datasets.fsbased] running compute_dataset_output_NP - Get filter splits for com.dataiku.dip.input.filter.InputFilter@1670c85d [2022/04/18-04:35:33.014] [ActivityExecutor-29] [INFO] [dku.datasets.fsbased] running compute_dataset_output_NP - Enumerate FS [2022/04/18-04:35:33.014] [ActivityExecutor-29] [INFO] [dku.datasets.bloblike] running compute_dataset_output_NP - Enumerating Filesystem dataset prefix= [2022/04/18-04:35:33.015] [ActivityExecutor-29] [INFO] [dku.fsproviders.google] running compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts/orders.csv (connectionChroot=) [2022/04/18-04:35:33.017] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:33.017] [ActivityExecutor-29] [INFO] [dku.utils.googlecloud] running compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:33.017] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:33.064] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:33.064] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Listing first items [2022/04/18-04:35:33.066] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:33.066] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:33.093] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:33.093] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:33.094] [ActivityExecutor-29] [INFO] [dku.fsproviders.google] running compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts (connectionChroot=) [2022/04/18-04:35:33.096] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:33.096] [ActivityExecutor-29] [INFO] [dku.utils.googlecloud] running compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:33.097] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:33.130] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:33.131] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Listing first items [2022/04/18-04:35:33.131] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:33.132] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:33.153] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:33.153] [ActivityExecutor-29] [DEBUG] [dku.gcs.client] running compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:33.153] [ActivityExecutor-29] [INFO] [dku.datasets.fsbased] running compute_dataset_output_NP - Enumerate done [2022/04/18-04:35:33.154] [ActivityExecutor-29] [DEBUG] [dku.job.activity] running compute_dataset_output_NP - Done filling source sizes [2022/04/18-04:35:33.155] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Recipe runner built, will use 1 thread(s) [2022/04/18-04:35:33.155] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Starting execution thread: com.dataiku.dip.recipes.code.python.PythonRecipeRunner@21e8ed18 [2022/04/18-04:35:33.156] [ActivityExecutor-29] [DEBUG] [dku.flow.activity] running compute_dataset_output_NP - Execution threads started, waiting for activity end [2022/04/18-04:35:33.158] [FRT-37-FlowRunnable] [INFO] [dku.flow.activity] act.compute_dataset_output_NP - Run thread for activity compute_dataset_output_NP starting [2022/04/18-04:35:33.160] [FRT-37-FlowRunnable] [INFO] [dku.flow.python] act.compute_dataset_output_NP - Starting execution of user's Python code [2022/04/18-04:35:33.165] [FRT-37-FlowRunnable] [INFO] [dku.venv.selector] act.compute_dataset_output_NP - Select code env lang=PYTHON projectSelection={"mode":"INHERIT","preventOverride":false} globalDefault=null [2022/04/18-04:35:33.192] [FRT-37-FlowRunnable] [DEBUG] [dku.remoterun.registry] act.compute_dataset_output_NP - Registering container execution python-epauhtc of type RECIPE_PYTHON [2022/04/18-04:35:33.193] [FRT-37-FlowRunnable] [INFO] [dku.containerexec.imageshelper] act.compute_dataset_output_NP - Finding out which image to use for requestedBase=null envLang=PYTHON envName=null envVersion=null [2022/04/18-04:35:33.194] [FRT-37-FlowRunnable] [INFO] [dku.containerexec.imageshelper] act.compute_dataset_output_NP - No env, using base [2022/04/18-04:35:33.194] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Executing recipe on Kubernetes with config=test-container-exec1, using image 'asia-southeast1-docker.pkg.dev/candidate-apac-vsatapute/test-docker-repo/dku-exec-base-uwputv8jfzxfqrzbz1nnxypp:dss-10.0.5' [2022/04/18-04:35:33.201] [FRT-37-FlowRunnable] [INFO] [dku.datasets.gcs] act.compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"dataset_output","connection":"GCS_Connection","path":"/DATAIKUTSHIRTS/dataset_output","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}} [2022/04/18-04:35:33.204] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/DATAIKUTSHIRTS/dataset_output (connectionChroot=) [2022/04/18-04:35:33.205] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:33.206] [FRT-37-FlowRunnable] [INFO] [dku.utils.googlecloud] act.compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:33.206] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:33.252] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - getObjectOrSubDirectory(DATAIKUTSHIRTS/dataset_output) [2022/04/18-04:35:33.252] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Listing first items [2022/04/18-04:35:33.253] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:33.253] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:33.292] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - List returned 0 objects and 1 sub-directories [2022/04/18-04:35:33.293] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Found sub-directory with name DATAIKUTSHIRTS/dataset_output [2022/04/18-04:35:33.295] [FRT-37-FlowRunnable] [INFO] [dku.datasets.gcs] act.compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"TShirts","connection":"GCS_Connection","path":"/candidate-apac-vsatapute/TShirts/orders.csv","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":["orders.csv"]}} [2022/04/18-04:35:33.297] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts/orders.csv (connectionChroot=) [2022/04/18-04:35:33.298] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:33.298] [FRT-37-FlowRunnable] [INFO] [dku.utils.googlecloud] act.compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:33.299] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:33.340] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:33.340] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Listing first items [2022/04/18-04:35:33.340] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:33.341] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:33.370] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:33.371] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:33.372] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts (connectionChroot=) [2022/04/18-04:35:33.373] [FRT-37-FlowRunnable] [INFO] [dku.datasets.gcs] act.compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"TShirts","connection":"GCS_Connection","path":"/candidate-apac-vsatapute/TShirts/orders.csv","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":["orders.csv"]}} [2022/04/18-04:35:33.375] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts/orders.csv (connectionChroot=) [2022/04/18-04:35:33.376] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:33.376] [FRT-37-FlowRunnable] [INFO] [dku.utils.googlecloud] act.compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:33.376] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:33.416] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - getObjectOrSubDirectory(candidate-apac-vsatapute/TShirts/orders.csv) [2022/04/18-04:35:33.417] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Listing first items [2022/04/18-04:35:33.417] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:33.417] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=candidate-apac-vsatapute/TShirts/orders.csv&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:33.432] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - List returned 1 objects and 0 sub-directories [2022/04/18-04:35:33.432] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Found object with name candidate-apac-vsatapute/TShirts/orders.csv [2022/04/18-04:35:33.434] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/candidate-apac-vsatapute/TShirts (connectionChroot=) [2022/04/18-04:35:33.465] [FRT-37-FlowRunnable] [WARN] [dku.code.projectLibs] act.compute_dataset_output_NP - External libraries file not found: /home/vinayak_satapute/dss_data/jobs/DATAIKUTSHIRTS/Build_dataset_output__NP__2022-04-18T04-35-31.800/localconfig/projects/DATAIKUTSHIRTS/lib/external-libraries.json [2022/04/18-04:35:33.467] [FRT-37-FlowRunnable] [INFO] [dku.code.projectLibs] act.compute_dataset_output_NP - EXTERNAL LIBS FROM DATAIKUTSHIRTS is {"gitReferences":{},"pythonPath":["python"],"rsrcPath":["R"],"importLibrariesFromProjects":[]} [2022/04/18-04:35:33.468] [FRT-37-FlowRunnable] [INFO] [dku.code.projectLibs] act.compute_dataset_output_NP - chunkFolder is /home/vinayak_satapute/dss_data/jobs/DATAIKUTSHIRTS/Build_dataset_output__NP__2022-04-18T04-35-31.800/localconfig/projects/DATAIKUTSHIRTS/lib/R [2022/04/18-04:35:33.488] [FRT-37-FlowRunnable] [DEBUG] [dku.resourceusage] act.compute_dataset_output_NP - Reporting start of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"admin","projectKey":"DATAIKUTSHIRTS","jobId":"Build_dataset_output__NP__2022-04-18T04-35-31.800","activityId":"compute_dataset_output_NP","activityType":"recipe","recipeType":"python","recipeName":"compute_dataset_output"},"type":"SINGLE_K8S_JOB","id":"4J28PPKZBiHcy9Nj","startTime":1650256533486,"singleK8SJob":{"k8sClusterId":"new-gke-cluster_1","executionId":"python-epauhtc"}} [2022/04/18-04:35:33.500] [FRT-37-FlowRunnable] [INFO] [dku.k8s.namespaces] act.compute_dataset_output_NP - Checking if namespace needs to be created [2022/04/18-04:35:33.501] [FRT-37-FlowRunnable] [DEBUG] [dku.k8s] act.compute_dataset_output_NP - Running kubectl (KUBECONFIG=/home/vinayak_satapute/dss_data/clusters/new-gke-cluster_1/exec/kube_config): kubectl --context context-new-gke-cluster_1 get namespace dssns-admin --ignore-not-found -o json [2022/04/18-04:35:33.745] [Thread-21] [DEBUG] [dku.utils] - Process kubectl done (return code 0) [2022/04/18-04:35:33.939] [Thread-24] [DEBUG] [dku.utils] - Process kubectl done (return code 0) [2022/04/18-04:35:33.941] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Waiting for kubernetes logs availability [2022/04/18-04:35:33.942] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Starting to wait for logs to be available [2022/04/18-04:35:33.942] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Getting pods [2022/04/18-04:35:34.039] [Thread-27] [DEBUG] [dku.utils] - Process kubectl done (return code 0) [2022/04/18-04:35:34.040] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Job dataiku-exec-python-epauhtc has 1 pods registered atm [2022/04/18-04:35:35.040] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Job now has pods, waiting for logs fetch to be successful [2022/04/18-04:35:35.040] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Calling logs on jobs/dataiku-exec-python-epauhtc [2022/04/18-04:35:35.170] [Thread-30] [INFO] [dku.utils] - Process kubectl completed, return code 1 [2022/04/18-04:35:35.171] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Get logs failed [2022/04/18-04:35:35.171] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Waiting for logs, time elapsed: 131 milliseconds, status changed to: Error from server (BadRequest): container "c" in pod "dataiku-exec-python-epauhtc--1-7h7qk" is waiting to start: ContainerCreating [2022/04/18-04:35:35.172] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Job has not started yet: 'Error from server (BadRequest): container "c" in pod "dataiku-exec-python-epauhtc--1-7h7qk" is waiting to start: ContainerCreating ' [2022/04/18-04:35:36.172] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Calling logs on jobs/dataiku-exec-python-epauhtc [2022/04/18-04:35:36.237] [Thread-33] [DEBUG] [dku.utils] - Process kubectl done (return code 0) [2022/04/18-04:35:36.239] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Getting logs succeeded, but checking that pods are indeed running [2022/04/18-04:35:36.333] [Thread-36] [DEBUG] [dku.utils] - Process kubectl done (return code 0) [2022/04/18-04:35:36.341] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Done waiting for logs to be available, trying to start streaming them [2022/04/18-04:35:36.342] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Fetch logs [2022/04/18-04:35:36.418] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,236] [1/MainThread] [INFO] [root] Fetching job definition [2022/04/18-04:35:36.418] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,237] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.418] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,238] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.419] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,238] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.419] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,238] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.419] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,241] [1/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:36.419] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,265] [1/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/containers/get-execution HTTP/1.1" 200 11932 [2022/04/18-04:35:36.421] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,266] [1/MainThread] [INFO] [root] got exec: {"dssVersion": "10.0.5", "id": "python-epauhtc", "authCtx": {"userGroupLevelPermissions": {"admin": true, "mayManageUDM": true, "mayCreateProjects": true, "mayCreateProjectsFromMacros": true, "mayCreateProjectsFromTemplates": true, "mayCreateProjectsFromDataikuApps": true, "mayWriteUnsafeCode": true, "mayWriteSafeCode": true, "mayCreateAuthenticatedConnections": true, "mayCreateCodeEnvs": true, "mayCreateClusters": true, "mayDevelopPlugins": true, "mayEditLibFolders": true, "mayManageCodeEnvs": true, "mayManageClusters": true, "mayViewIndexedHiveConnections": true, "mayCreatePublishedAPIServices": true, "mayCreatePublishedProjects": true, "mayWriteInRootProjectFolder": true, "mayCreateActiveWebContent": true, "mayCreateWorkspaces": true, "mayShareToWorkspaces": true, "canObtainAPITicketFromCookiesForGroupsRegex": ""}, "via": [], "authSource": "USER_FROM_UI", "realUserLogin": "admin", "userGroups": ["administrators"], "userProfile": "DESIGNER"}, "projectKey": "DATAIKUTSHIRTS", "type": "RECIPE_PYTHON", "definition": null, "payload": null, "codeEnvLang": "PYTHON", "envResource": null} [2022/04/18-04:35:36.421] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,268] [1/MainThread] [INFO] [root] Executing Python recipe [2022/04/18-04:35:36.421] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,268] [1/MainThread] [INFO] [root] Fetching project libraries [2022/04/18-04:35:36.421] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,268] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.421] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,269] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.422] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,269] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:36.422] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,271] [1/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:36.422] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,305] [1/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 None [2022/04/18-04:35:36.422] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,308] [1/MainThread] [INFO] [root] Fetching instance libraries [2022/04/18-04:35:37.423] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,308] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.423] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,308] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.423] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,309] [1/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.424] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,310] [1/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:37.424] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,333] [1/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 None [2022/04/18-04:35:37.424] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:36,339] [1/MainThread] [INFO] [root] Running user code [2022/04/18-04:35:37.905] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,869] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.906] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,871] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.906] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,872] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.906] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,874] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:37.906] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,879] [9/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:37.906] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,895] [9/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/datasets/get-schema/ HTTP/1.1" 200 351 [2022/04/18-04:35:37.907] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,898] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.651] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,899] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.651] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,900] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.651] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,901] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.652] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:37,905] [9/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:38.652] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,239] [9/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/datasets/read-data/ HTTP/1.1" 200 None [2022/04/18-04:35:38.652] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,645] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.652] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,647] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.652] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,648] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.711] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,649] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.711] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,653] [9/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:38.712] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,696] [9/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/datasets/set-schema/ HTTP/1.1" 200 0 [2022/04/18-04:35:38.712] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,698] [9/MainThread] [INFO] [dataiku.core.dataset_write] Initializing dataset writer for dataset DATAIKUTSHIRTS.dataset_output [2022/04/18-04:35:38.712] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,700] [9/MainThread] [INFO] [dataiku.core.dataset_write] Initializing write session [2022/04/18-04:35:38.712] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,701] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.713] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,702] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.713] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,703] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.750] [qtp1858583776-23] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWritingService] - Init write session: yiw4cIScRs (current count=1) [2022/04/18-04:35:38.751] [qtp1858583776-23] [DEBUG] [dku.jobs] - Command /tintercom/datasets/init-write-session processed in 36ms [2022/04/18-04:35:38.762] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,704] [9/MainThread] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.762] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,707] [9/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:38.762] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,752] [9/MainThread] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "POST /kernel/tintercom/datasets/init-write-session/ HTTP/1.1" 200 24 [2022/04/18-04:35:38.762] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,756] [9/Thread-1] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.763] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,756] [9/MainThread] [INFO] [dataiku.core.dataset_write] Starting RemoteStreamWriter [2022/04/18-04:35:38.763] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,757] [9/Thread-1] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.763] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,759] [9/Thread-1] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.815] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,760] [9/Thread-1] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.816] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,764] [9/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:38.816] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,766] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Initializing write data stream (yiw4cIScRs) [2022/04/18-04:35:38.816] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,780] [9/Thread-2] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.816] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,783] [9/Thread-2] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.816] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,784] [9/Thread-2] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.817] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,785] [9/Thread-2] [DEBUG] [root] Verifying SSL calls with certificate /home/dataiku/rpc_server_cert.pem [2022/04/18-04:35:38.817] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,789] [9/Thread-2] [DEBUG] [urllib3.connectionpool] Starting new HTTP connection (1): dss-instance-centos:36650 [2022/04/18-04:35:38.817] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,811] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Remote Stream Writer: start generate [2022/04/18-04:35:38.909] [qtp1858583776-22] [INFO] [dku.datasets.gcs] - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"dataset_output","connection":"GCS_Connection","path":"/DATAIKUTSHIRTS/dataset_output","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}} [2022/04/18-04:35:38.909] [qtp1858583776-22] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWriter] - Overwrite: clearing output [2022/04/18-04:35:38.910] [qtp1858583776-22] [INFO] [dku.datasets.bloblike] - Clear all data [2022/04/18-04:35:38.911] [qtp1858583776-22] [INFO] [dku.fsproviders.google] - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/DATAIKUTSHIRTS/dataset_output (connectionChroot=) [2022/04/18-04:35:38.912] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:38.912] [qtp1858583776-22] [INFO] [dku.utils.googlecloud] - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:38.912] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:38.946] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - getObjectOrSubDirectory(DATAIKUTSHIRTS/dataset_output) [2022/04/18-04:35:38.946] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Listing first items [2022/04/18-04:35:38.946] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:38.947] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:38.970] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - List returned 0 objects and 1 sub-directories [2022/04/18-04:35:38.970] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Found sub-directory with name DATAIKUTSHIRTS/dataset_output [2022/04/18-04:35:38.970] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - getObjectOrSubDirectory(DATAIKUTSHIRTS/dataset_output) [2022/04/18-04:35:38.970] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Listing first items [2022/04/18-04:35:38.971] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:38.971] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:39.006] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - List returned 0 objects and 1 sub-directories [2022/04/18-04:35:39.006] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Found sub-directory with name DATAIKUTSHIRTS/dataset_output [2022/04/18-04:35:39.007] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:39.007] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&project=candidate-apac-vsatapute [2022/04/18-04:35:39.033] [qtp1858583776-22] [INFO] [dku.gcs.client] - Already have 0, received page of 1 elements [2022/04/18-04:35:39.033] [qtp1858583776-22] [INFO] [dku.gcs.client] - Found 1 elements [2022/04/18-04:35:39.034] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Delete object https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o/DATAIKUTSHIRTS%2Fdataset_output%2Fout-s0.csv.gz project candidate-apac-vsatapute [2022/04/18-04:35:39.387] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Delete executed [2022/04/18-04:35:39.388] [qtp1858583776-22] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWriter] - Creating output writer [2022/04/18-04:35:39.392] [qtp1858583776-22] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWriter] - Initializing output writer [2022/04/18-04:35:39.392] [qtp1858583776-22] [INFO] [dku.output.file] - INIT Resplittable [2022/04/18-04:35:39.392] [qtp1858583776-22] [INFO] [dku.fsproviders.google] - get blob /DATAIKUTSHIRTS/dataset_output/out-s0.csv.gz from bucket dataiku_dss_bucket1 [2022/04/18-04:35:39.393] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1/o/DATAIKUTSHIRTS%2Fdataset_output%2Fout-s0.csv.gz project candidate-apac-vsatapute [2022/04/18-04:35:39.393] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o/DATAIKUTSHIRTS%2Fdataset_output%2Fout-s0.csv.gz?project=candidate-apac-vsatapute [2022/04/18-04:35:39.422] [qtp1858583776-22] [INFO] [dku.output.file] - Writing base=/ split=0 chunk=0 -> target = out-s0.csv.gz [2022/04/18-04:35:39.423] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Init upload on dataiku_dss_bucket1 [2022/04/18-04:35:39.423] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - POST https://www.googleapis.com/upload/storage/v1/b/dataiku_dss_bucket1/o [2022/04/18-04:35:39.455] [qtp1858583776-22] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWriter] - Done initializing output writer [2022/04/18-04:35:39.631] [qtp1858583776-22] [INFO] [dku.datasets] - Emitted 10000 rows [2022/04/18-04:35:39.764] [qtp1858583776-22] [INFO] [dku.datasets] - Emitted 20000 rows [2022/04/18-04:35:39.827] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,814] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Waiting for data to send ... [2022/04/18-04:35:39.827] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:38,906] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Sending data (1888148) [2022/04/18-04:35:39.827] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:39,725] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Waiting for data to send ... [2022/04/18-04:35:39.827] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:39,725] [9/MainThread] [INFO] [dataiku.core.dataset_write] Remote Stream Writer closed [2022/04/18-04:35:39.827] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:39,725] [9/Thread-2] [INFO] [dataiku.core.dataset_write] Got end mark, ending send [2022/04/18-04:35:39.852] [qtp1858583776-22] [INFO] [dku.gcs.client.upload] - Uploading chunk 0-344489/344490 into [bucket=dataiku_dss_bucket1, name=DATAIKUTSHIRTS/dataset_output/out-s0.csv.gz] with content-length=344490, content-range=0-344489/344490 [2022/04/18-04:35:39.853] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - PUT https://www.googleapis.com/upload/storage/v1/b/dataiku_dss_bucket1/o?bucket=dataiku_dss_bucket1&uploadType=resumable&name=DATAIKUTSHIRTS/dataset_output/out-s0.csv.gz&project=candidate-apac-vsatapute&upload_id=ADPycdtHBYR5lp7nEoa2o3QdVsdyd6QCdinUVTprBJTIa8DG_WhD7SzdxQpnmmFbdVukk0DMF1ggr9AeXOjBDlqRFzZqCw [2022/04/18-04:35:40.136] [qtp1858583776-22] [INFO] [dku.gcs.client.upload] - Upload successful for [bucket=dataiku_dss_bucket1, name=DATAIKUTSHIRTS/dataset_output/out-s0.csv.gz] [2022/04/18-04:35:40.137] [qtp1858583776-22] [INFO] [dku.fsproviders.google] - Waiting for GoogleCloudStorage write to complete, path=/out-s0.csv.gz [2022/04/18-04:35:40.137] [qtp1858583776-22] [INFO] [dku.fsproviders.google] - get blob /DATAIKUTSHIRTS/dataset_output/out-s0.csv.gz from bucket dataiku_dss_bucket1 [2022/04/18-04:35:40.137] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - Get object b/dataiku_dss_bucket1/o/DATAIKUTSHIRTS%2Fdataset_output%2Fout-s0.csv.gz project candidate-apac-vsatapute [2022/04/18-04:35:40.137] [qtp1858583776-22] [DEBUG] [dku.gcs.client] - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o/DATAIKUTSHIRTS%2Fdataset_output%2Fout-s0.csv.gz?project=candidate-apac-vsatapute [2022/04/18-04:35:40.179] [qtp1858583776-22] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWritingService] - Pushed data to write session yiw4cIScRs : 26552 rows [2022/04/18-04:35:40.180] [qtp1858583776-22] [DEBUG] [dku.jobs] - Command /tintercom/datasets/push-data processed in 1273ms [2022/04/18-04:35:40.180] [qtp1858583776-19] [INFO] [com.dataiku.dip.dataflow.streaming.DatasetWritingService] - Finished write session: yiw4cIScRs (current count=0) [2022/04/18-04:35:40.181] [qtp1858583776-19] [DEBUG] [dku.jobs] - Command /tintercom/datasets/wait-write-session processed in 1393ms [2022/04/18-04:35:40.828] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:40,182] [9/Thread-1] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "GET /kernel/tintercom/datasets/wait-write-session/?id=yiw4cIScRs HTTP/1.1" 200 59 [2022/04/18-04:35:40.828] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - Installing debugging signal handler [2022/04/18-04:35:40.828] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - 26552 rows successfully written (yiw4cIScRs) [2022/04/18-04:35:40.829] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - [2022-04-18 04:35:40,473] [1/MainThread] [INFO] [root] Containerized process exited with status 0 [2022/04/18-04:35:40.829] [kubectl-stream-logs-out-58] [INFO] [dku.utils] - Installing debugging signal handler [2022/04/18-04:35:41.481] [Thread-41] [DEBUG] [dku.utils] - Process kubectl-stream-logs done (return code 0) [2022/04/18-04:35:41.983] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Check if pods could still produce logs [2022/04/18-04:35:42.046] [Thread-44] [DEBUG] [dku.utils] - Process kubectl-get-pods done (return code 0) [2022/04/18-04:35:42.049] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Pods phases are {"Running":1} [2022/04/18-04:35:42.049] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Container states are {"terminated":1} [2022/04/18-04:35:42.051] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Fetch logs since 1568 ms [2022/04/18-04:35:42.114] [kubectl-stream-logs-out-68] [INFO] [dku.utils] - [2022-04-18 04:35:40,182] [9/Thread-1] [DEBUG] [urllib3.connectionpool] http://dss-instance-centos:36650 "GET /kernel/tintercom/datasets/wait-write-session/?id=yiw4cIScRs HTTP/1.1" 200 59 [2022/04/18-04:35:42.115] [Thread-49] [DEBUG] [dku.utils] - Process kubectl-stream-logs done (return code 0) [2022/04/18-04:35:42.116] [kubectl-stream-logs-out-68] [INFO] [dku.utils] - Installing debugging signal handler [2022/04/18-04:35:42.116] [kubectl-stream-logs-out-68] [INFO] [dku.utils] - 26552 rows successfully written (yiw4cIScRs) [2022/04/18-04:35:42.116] [kubectl-stream-logs-out-68] [INFO] [dku.utils] - [2022-04-18 04:35:40,473] [1/MainThread] [INFO] [root] Containerized process exited with status 0 [2022/04/18-04:35:42.117] [kubectl-stream-logs-out-68] [INFO] [dku.utils] - Installing debugging signal handler [2022/04/18-04:35:42.617] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Check if pods could still produce logs [2022/04/18-04:35:42.671] [Thread-52] [DEBUG] [dku.utils] - Process kubectl-get-pods done (return code 0) [2022/04/18-04:35:42.673] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Pods phases are {"Running":1} [2022/04/18-04:35:42.673] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Container states are {"terminated":1} [2022/04/18-04:35:42.673] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Fetch logs since 1556 ms [2022/04/18-04:35:42.747] [Thread-57] [DEBUG] [dku.utils] - Process kubectl-stream-logs done (return code 0) [2022/04/18-04:35:43.248] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Check if pods could still produce logs [2022/04/18-04:35:43.302] [Thread-60] [DEBUG] [dku.utils] - Process kubectl-get-pods done (return code 0) [2022/04/18-04:35:43.304] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Pods phases are {"Running":1} [2022/04/18-04:35:43.304] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Container states are {"terminated":1} [2022/04/18-04:35:43.304] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Fetch logs since 1556 ms [2022/04/18-04:35:43.369] [Thread-65] [DEBUG] [dku.utils] - Process kubectl-stream-logs done (return code 0) [2022/04/18-04:35:43.870] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Check if pods could still produce logs [2022/04/18-04:35:43.925] [Thread-68] [DEBUG] [dku.utils] - Process kubectl-get-pods done (return code 0) [2022/04/18-04:35:43.926] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Pods phases are {"Succeeded":1} [2022/04/18-04:35:43.926] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Container states are {"terminated":1} [2022/04/18-04:35:43.926] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Log streaming terminated with return code 0 [2022/04/18-04:35:43.926] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Waiting for kubernetes job to finish [2022/04/18-04:35:43.926] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - wait for job to complete, getting job status [2022/04/18-04:35:43.927] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Querying job status on job dataiku-exec-python-epauhtc- try number 1 [2022/04/18-04:35:43.979] [Thread-71] [DEBUG] [dku.utils] - Process kubectl-get-job done (return code 0) [2022/04/18-04:35:43.980] [FRT-37-FlowRunnable] [DEBUG] [dku.containers.kubernetes] act.compute_dataset_output_NP - kubectl get job OK, out=Complete [2022/04/18-04:35:43.980] [FRT-37-FlowRunnable] [INFO] [dku.containers.kubernetes] act.compute_dataset_output_NP - Kubernetes job is complete [2022/04/18-04:35:43.981] [FRT-37-FlowRunnable] [DEBUG] [dku.remoterun.registry] act.compute_dataset_output_NP - Finished with container execution python-epauhtc [2022/04/18-04:35:43.981] [FRT-37-FlowRunnable] [DEBUG] [dku.resourceusage] act.compute_dataset_output_NP - Reporting completion of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"admin","projectKey":"DATAIKUTSHIRTS","jobId":"Build_dataset_output__NP__2022-04-18T04-35-31.800","activityId":"compute_dataset_output_NP","activityType":"recipe","recipeType":"python","recipeName":"compute_dataset_output"},"type":"SINGLE_K8S_JOB","id":"4J28PPKZBiHcy9Nj","startTime":1650256533486,"singleK8SJob":{"k8sClusterId":"new-gke-cluster_1","executionId":"python-epauhtc"}} [2022/04/18-04:35:43.981] [FRT-37-FlowRunnable] [INFO] [dku.recipes.code.base] act.compute_dataset_output_NP - Cleaning Kubernetes job [2022/04/18-04:35:43.987] [FRT-37-FlowRunnable] [INFO] [dku.security.process] act.compute_dataset_output_NP - Starting process (regular) [2022/04/18-04:35:43.997] [FRT-37-FlowRunnable] [INFO] [dku.security.process] act.compute_dataset_output_NP - Process started with pid=24027 [2022/04/18-04:35:44.071] [null-out-95] [INFO] [dku.utils] - secret "dkusecret-python-epauhtc" deleted [2022/04/18-04:35:44.103] [null-out-95] [INFO] [dku.utils] - job.batch "dataiku-exec-python-epauhtc" deleted [2022/04/18-04:35:44.168] [FRT-37-FlowRunnable] [INFO] [dku.flow.python] act.compute_dataset_output_NP - Execution of user's Python code complete [2022/04/18-04:35:44.172] [FRT-37-FlowRunnable] [INFO] [dku.datasets.gcs] act.compute_dataset_output_NP - Building GCS handler config: {"bucket":"dataiku_dss_bucket1","metastoreSynchronizationEnabled":true,"metastoreTableName":"dataset_output","connection":"GCS_Connection","path":"/DATAIKUTSHIRTS/dataset_output","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}} [2022/04/18-04:35:44.172] [FRT-37-FlowRunnable] [INFO] [dku.datasets.fsbased] act.compute_dataset_output_NP - Get filter splits for com.dataiku.dip.input.filter.InputFilter@26b1dbe4 [2022/04/18-04:35:44.172] [FRT-37-FlowRunnable] [INFO] [dku.datasets.fsbased] act.compute_dataset_output_NP - Enumerate FS [2022/04/18-04:35:44.172] [FRT-37-FlowRunnable] [INFO] [dku.datasets.bloblike] act.compute_dataset_output_NP - Enumerating Filesystem dataset prefix= [2022/04/18-04:35:44.173] [FRT-37-FlowRunnable] [INFO] [dku.fsproviders.google] act.compute_dataset_output_NP - GCS provider bucket=dataiku_dss_bucket1 effectiveRoot=/DATAIKUTSHIRTS/dataset_output (connectionChroot=) [2022/04/18-04:35:44.174] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1 project candidate-apac-vsatapute [2022/04/18-04:35:44.174] [FRT-37-FlowRunnable] [INFO] [dku.utils.googlecloud] act.compute_dataset_output_NP - Setup httpTransport hasProxy=false useApache=false [2022/04/18-04:35:44.174] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1?project=candidate-apac-vsatapute [2022/04/18-04:35:44.223] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - getObjectOrSubDirectory(DATAIKUTSHIRTS/dataset_output) [2022/04/18-04:35:44.224] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Listing first items [2022/04/18-04:35:44.224] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:44.224] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&delimiter=/&maxResults=32&project=candidate-apac-vsatapute [2022/04/18-04:35:44.246] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - List returned 0 objects and 1 sub-directories [2022/04/18-04:35:44.246] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Found sub-directory with name DATAIKUTSHIRTS/dataset_output [2022/04/18-04:35:44.247] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - Get object b/dataiku_dss_bucket1/o project candidate-apac-vsatapute [2022/04/18-04:35:44.247] [FRT-37-FlowRunnable] [DEBUG] [dku.gcs.client] act.compute_dataset_output_NP - GET https://www.googleapis.com/storage/v1/b/dataiku_dss_bucket1/o?prefix=DATAIKUTSHIRTS/dataset_output&project=candidate-apac-vsatapute [2022/04/18-04:35:44.280] [FRT-37-FlowRunnable] [INFO] [dku.gcs.client] act.compute_dataset_output_NP - Already have 0, received page of 1 elements [2022/04/18-04:35:44.280] [FRT-37-FlowRunnable] [INFO] [dku.gcs.client] act.compute_dataset_output_NP - Found 1 elements [2022/04/18-04:35:44.282] [FRT-37-FlowRunnable] [INFO] [dku.datasets.fsbased] act.compute_dataset_output_NP - Enumerate done [2022/04/18-04:35:44.283] [FRT-37-FlowRunnable] [INFO] [dku.flow.activity] act.compute_dataset_output_NP - Run thread done for activity compute_dataset_output_NP [2022/04/18-04:35:44.384] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - activity is finished [2022/04/18-04:35:44.384] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Executing default post-activity lifecycle hook [2022/04/18-04:35:44.400] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Activity successful, computing metrics and running checks [2022/04/18-04:35:44.806] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Activity checks produced 0 value [2022/04/18-04:35:44.807] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Activity is successful, computing timestamps to propagate [2022/04/18-04:35:44.811] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Activity is successful, propagating 3 timestamps [2022/04/18-04:35:44.811] [ActivityExecutor-29] [INFO] [dku.timestamps.sql] running compute_dataset_output_NP - Starting to propagate 3 hashes [2022/04/18-04:35:44.819] [ActivityExecutor-29] [DEBUG] [dku.connections.sql.provider] running compute_dataset_output_NP - Commit conn=dssdb-h2-flow_state-hK7TYol [2022/04/18-04:35:44.820] [ActivityExecutor-29] [INFO] [dku.timestamps.sql] running compute_dataset_output_NP - Hashes propagated in 9 ms [2022/04/18-04:35:44.820] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Removing samples for DATAIKUTSHIRTS.dataset_output [2022/04/18-04:35:44.821] [ActivityExecutor-29] [INFO] [dku.flow.activity] running compute_dataset_output_NP - Done post-activity tasks [2022/04/18-04:35:45.205] [qtp1858583776-23] [INFO] [dku.jobs] - Connects using Shared secret [2022/04/18-04:35:45.205] [qtp1858583776-23] [DEBUG] [dku.jobs] - Received command : /pintercom/stop_session [2022/04/18-04:35:45.206] [qtp1858583776-23] [DEBUG] [dku.jobs] - Command /pintercom/stop_session processed in 1ms