Plugins & Extending Dataiku
- Hello, I am working with a time series dataset and wanted to use the Time Series Preparation Plugin. However, I've received an STL import error. I tried to follow the steps in the following link but i…
Last answer by AlexandruHi @ChaimaeHm
,
It looks like you may have a DNS issue on your VirtualBox instance.
Perhaps you need to configure a proxy if your organization requires one to make outbound connection.
As a test, can you try to manually install and see if you have the same error from the CLI of the VM:
pip install --index-url=https://pypi.org/simple/ statsmodels
To add a proxy you can modify :
You can add DATADIR/bin/env-site.shexport HTTP_PROXY=http://<proxy-server>:<proxy-port>
export HTTPS_PROXY=https://<proxy-server>:<proxy-port>
ThanksLast answer by AlexandruHi @ChaimaeHm
,
It looks like you may have a DNS issue on your VirtualBox instance.
Perhaps you need to configure a proxy if your organization requires one to make outbound connection.
As a test, can you try to manually install and see if you have the same error from the CLI of the VM:
pip install --index-url=https://pypi.org/simple/ statsmodels
To add a proxy you can modify :
You can add DATADIR/bin/env-site.shexport HTTP_PROXY=http://<proxy-server>:<proxy-port>
export HTTPS_PROXY=https://<proxy-server>:<proxy-port>
Thanks - I have this error when I run open AI plugin on a csv file. It happens for anything that i request. There is no extra explanation. Would you let me know what is the reason?Oops: an unexpected error occ…Last answer by
Last answer by saeed396Hi Alex!
I couldn't find chat place or link. Could you send me the link for chat. Also I sent the error's zip file through the email that I received from community.
Thank you,
Saeed
- How to Extract weather data of past 2 years using OpenWeatherMap Plugin? I want to find the temp and humidity of a location for past 2 years. Can i use the OpenWeatherMap API for the same? if YES, the…Last answer by
Last answer by tgb417Are you aware of any "... publicly available large historical dataset..." about weather?
Is there a python library or R package that make accessing this kind of thing easy to get from public data source?
Back in 2019 the Dataiku Dark Sky, Forcast.io, and Wunderground Plugins by Jérémy Grèze were very helpful in such use cases, were I was successfully able to pull 20 years of historical data for a particular location. Since those plugins were pulled, I've not found it as easy to answer the kind of question that @BhaskarDevGoel
has.I suspect that pulling the plugins had more to do about changes at the data providers than at Dataiku. But it would be great to have a "semi-standard" way to do this kind of enrichment. Particularly if the current OpenWeatherMap Plug-In data goes back only 5-7 days. It is hard to build a model on this little data.
Should we put in a Product Idea for this one.
- Hello! I have a table with 3 columns: 1. Revenue Start Date 2. Revenue End Date 3. Daily revenue for the defined period of time I want to calculate the total daily revenue at for any date. Is there a …Last answer by
Last answer by JordanBHi @SGovetto
,As of DSS version 11, Time Series Forecasting is natively available in DSS Visual ML with support for multiple time series. https://doc.dataiku.com/dss/latest/release_notes/11.html#major-new-features Just select your time series dataset > lab > time series forecasting.
You may also download the plugin Time Series Preparation to perform resampling, interval extraction, and more: https://www.dataiku.com/product/plugins/timeseries-preparation/
Thanks!
Jordan
- I am trying to create a small custom plugin in dataiku. It will only have a dataset component. Ideally it should call, for the lack of a better word, lets say an endpoint which returns data in the for…Last answer byLast answer by Alexandru
Hi,
For generate_rows please see the example here :
https://doc.dataiku.com/dss/latest/python-api/plugins/custom_datasets.html#dataiku.connector.Connector.generate_rows
You can look at existing dataset plugin like API Connect for detailed examples.
Thanks - Hi everyone I try to import Splunk data using the official: plugin. The problem is, that the plugin seems to assume all my Splunk data is ascii encoded, when in reality it is UTF-8. The plugin has no …Solution by
Solution by AlexBHi !
Could you try to convert this plugin into a dev plugin, then edit line 91 of the file named `python-connectors/splunk_import-index/connector.py`, from this:
for sample in content.decode().split("\n"):into this:
for sample in content.decode("utf-8").split("\n"):and see if it solves the issue..
- Hi there, I am using the Forecasting Plugin to train a forecasting model for a time series commodities dataset. However, I have a few issues with regards to setting up a functional code environment fo…Last answer by
Last answer by CatalinaThe native time series forecasting feature is available in DSS11 in the Lab section - Visual ML -Time Series Forecasting.
- Hey We were trying to execute some stan code on dataiku using stan.build and was facing issues. So we wanted a confirmation on whether the pystan is compatible with Dataiku. If compatible, what versio…Last answer byLast answer by amith_yadav
Thanks for the response @CatalinaS
. But the example code link to use PyStan 3 which you have shared is not opening up.We were getting the below error with PyStan 3. I have attached the screenshot as well. This is working fine with PyStan 2 but we have to get this done with PyStan 3 as well. Please let us know what could be the issue and how to resolve the error.
Building: 28.2s, done.Messages from stanc: Warning: The parameter mu has no priors. Warning: The parameter tau has no priors. Error handling request Traceback (most recent call last): File "/data/dataiku/dss_data/code-envs/python/personal_aammi_py37/lib/python3.7/site-packages/aiohttp/web_protocol.py", line 433, in _handle_request resp = await request_handler(request) File "/data/dataiku/dss_data/code-envs/python/personal_aammi_py37/lib/python3.7/site-packages/aiohttp/web_app.py", line 504, in _handle resp = await handler(request) File "/data/dataiku/dss_data/code-envs/python/personal_aammi_py37/lib/python3.7/site-packages/httpstan/views.py", line 253, in handle_show_params services_module = httpstan.models.import_services_extension_module(model_name) File "/data/dataiku/dss_data/code-envs/python/personal_aammi_py37/lib/python3.7/site-packages/httpstan/models.py", line 90, in import_services_extension_module module: ModuleType = importlib.util.module_from_spec(spec) # type: ignore File "<frozen importlib._bootstrap>", line 583, in module_from_spec File "<frozen importlib._bootstrap_external>", line 1043, in create_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed ImportError: /home/dssuser_aammi/.cache/httpstan/4.4.2/models/gqxgg3k4/stan_services_model_gqxgg3k4.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZNSt18basic_stringstreamIcSt11char_traitsIcESaIcEEC1Ev - Hi All. Editing my question to help better understand. In a custom recipe or custom macro We have the option to define a parameter as mandatory "mandatory":true Can someone please help check if this o…Solution bySolution by Alexandru
Testing this "required": true works for inputRoles/outputRoles.
However, for params using mandatory or required has no effect within recipe component. You could handle this in recipe code directly when reading the parameters here is an example of how this is done from another Plugin recipe
text_column_name = recipe_config.get('text_column_name', None) if text_column_name is None: raise ValueError("You did not choose a text column.") n_sentences = recipe_config.get('n_sentences', None) if n_sentences is None: raise ValueError("You did not set a number of sentences.") method = recipe_config.get('method', None) if method is None: raise ValueError("You did not choose a summarization method.")Let me know if this helps.
- Hi, I tried to follow the tutorial to create a plugin based on Bokeh WebApp : https://academy.dataiku.com/plugin-examples/513345 But I obtained this error "WebApp not trust" (cf error_screen) I precis…Solution by
Solution by CGBHi,
After multiple tests, I share the solution used because it could helps others dataikers :
- In json file, I removed the role array.
- After that, my webapp becomes available as Visual Webapp on my project's webapp page and it works well
=> 
It's not optimal because I can't use roles but at least, it works.
@Dataiku
, please note that your tutorial is currently NOT working.