Using Dataiku

Hi @ldj002e
,

This can happen when your Prepare recipe has invalid steps. Your second to last recipe step seems to be causing the issue here.

Hi @ldj002e
,

This can happen when your Prepare recipe has invalid steps. Your second to last recipe step seems to be causing the issue here.

Hi @afostor
,
There is no specific way to do this in the API endpoint. Usually testing is done using the test queries in API Designer directly.

If you want to perform additional test, you can write a unit test directly in the API endpoint code directly and only invoke this when using param perform_test= true.

import unittest
import traceback

# Insert here initialization code
class TestApiPyFunction(unittest.TestCase):

    def test_api_py_function(self):
        # Test case 1 pass
        result = api_py_function(2, 3, 4)
        self.assertEqual(result, 2 + 3 * 4)  # Expected: 2 + 3 * 4 = 14

        # Test case 2 (Intentional failure)
        result = api_py_function(0, 5, 10)
        self.assertEqual(result, 0 + 5 * 10 + 1)  # Expected: 0 + 5 * 10 + 1 = 51

 
        return "All tests passed successfully."

def api_py_function(param1, param2, param3, perform_test=False):
    result = param1 + param2 * param3
    if perform_test:
        try:
            # Run the test cases if perform_test is True
            # The test cases are defined below in the TestApiPyFunction class
            test_result = TestApiPyFunction().test_api_py_function()
        except AssertionError as e:
            tb = traceback.format_exc()
            return result, tb
        return result, "All tests passed successfully."
    return result

Hi @afostor
,
There is no specific way to do this in the API endpoint. Usually testing is done using the test queries in API Designer directly.

If you want to perform additional test, you can write a unit test directly in the API endpoint code directly and only invoke this when using param perform_test= true.

import unittest
import traceback

# Insert here initialization code
class TestApiPyFunction(unittest.TestCase):

    def test_api_py_function(self):
        # Test case 1 pass
        result = api_py_function(2, 3, 4)
        self.assertEqual(result, 2 + 3 * 4)  # Expected: 2 + 3 * 4 = 14

        # Test case 2 (Intentional failure)
        result = api_py_function(0, 5, 10)
        self.assertEqual(result, 0 + 5 * 10 + 1)  # Expected: 0 + 5 * 10 + 1 = 51

 
        return "All tests passed successfully."

def api_py_function(param1, param2, param3, perform_test=False):
    result = param1 + param2 * param3
    if perform_test:
        try:
            # Run the test cases if perform_test is True
            # The test cases are defined below in the TestApiPyFunction class
            test_result = TestApiPyFunction().test_api_py_function()
        except AssertionError as e:
            tb = traceback.format_exc()
            return result, tb
        return result, "All tests passed successfully."
    return result

You should use the Dataiku API package since you are going to call the Dataiku API from the API node and that's considered outside DSS:

import dataikuapi

dataiku_url = 'https://dss_url/'
dataiku_api_key = 'API key'

external_client = dataikuapi.DSSClient(dataiku_url, dataiku_api_key)
# Only needed if you are using SSL and need to ignore the SSL cert validation
# external_client._session.verify = False

project_handle = external_client.get_project('your_project_key')
project_variables = project_handle.get_variables()

Also once you are outside DSS you need to set a project key first before you can retrieve the project variables since things don't run inside a project like recipes, jobs and scenarios do in DSS. Finally your incorrectly named method getcustom_variables() (the correct name is get_custom_variables()) is called get_variables() in the dataikuapi package.

Hi @MyNamesJames
,

You can create a resources init script from the API like so:

import dataiku

client = dataiku.api_client()
code_env = client.get_code_env('PYTHON','<CODE_ENV_NAME>')
settings = code_env.get_settings()

raw_settings = settings.get_raw()
raw_settings['resourcesInitScript'] = 'NEW SCRIPT CONTENTS'

# save the settings 
settings.save()

Let us know if you have any questions about this.

Thank you,
Sarina