DataIKU visual webapp with Gemini 1.5 pro

Georghios

If I use Gemini 1.5, the upload option is visible to upload user files as you can see below:

But there's an error when using it with or without uploaded files:

File "/data/dataiku/dss_data/web_apps/DS1948/V9u5gZh/python-lib/backend/routes/ws/answer_streaming.py", line 173, in process_and_stream_answer for chunk in llm_qa.get_answer_and_sources(query=request_info["query"], chat_history=request_info["history"], filters=request_info["filters"], File "/data/dataiku/dss_data/web_apps/DS1948/V9u5gZh/python-lib/solutions/service.py", line 519, in run_non_streaming_mode yield self.get_as_json(qa_chain.predict(input=user_question), filters=filters, knowledge_bank_selection=knowledge_bank_selection) File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/llm.py", line 293, in predict return self(kwargs, callbacks=callbacks)[self.output_key] File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/_api/deprecation.py", line 148, in warning_emitting_wrapper return wrapped(*args, **kwargs) File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/base.py", line 378, in __call__ return self.invoke( File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/base.py", line 163, in invoke raise e File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/base.py", line 153, in invoke self._call(inputs, run_manager=run_manager) File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/llm.py", line 103, in _call response = self.generate([inputs], run_manager=run_manager) File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain/chains/llm.py", line 115, in generate return self.llm.generate_prompt( File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/language_models/llms.py", line 633, in generate_prompt return self.generate(prompt_strings, stop=stop, callbacks=callbacks, **kwargs) File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/language_models/llms.py", line 803, in generate output = self._generate_helper( File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/language_models/llms.py", line 670, in _generate_helper raise e File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/language_models/llms.py", line 657, in _generate_helper self._generate( File "/opt/dataiku-dss-12.6.1/python/dataiku/langchain/dku_llm.py", line 118, in _generate raise Exception("LLM call failed: %s" % resp._raw.get("errorMessage", "Unknown error"))AttributeError: 'list' object has no attribute 'get'/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/langchain_core/_api/deprecation.py:119: LangChainDeprecationWarning: The method `Chain.run` was deprecated in langchain 0.1.0 and will be removed in 0.2.0. Use invoke instead. warn_deprecated(2024-06-10 10:34:08,469 INFO Executing completion on DKULLM with settings: {'temperature': 0, 'maxOutputTokens': 1024}2024-06-10 10:34:08,514 - llm_assist.logging - ERROR - Error storing message in DB 'list' object has no attribute 'get'2024-06-10 10:34:08,519 - llm_assist.logging - INFO - Client disconnected2024-06-10 10:34:08,561 INFO 127.0.0.1 - - [10/Jun/2024 10:34:08] "[35m[1mGET /stream/?EIO=4&transport=websocket HTTP/1.1[0m" 500 -2024-06-10 10:34:08,567 INFO Starting SQL query reader2024-06-10 10:34:08,572 ERROR Error on request:Traceback (most recent call last): File "/data/dataiku/dss_data/code-envs/python/plugin_document-question-answering_managed/lib/python/site-packages/werkzeug/serving.py", line 362, in run_wsgi execute(self.server.app) File "python/plugin_document-question-answering_managed/lib/python/site-packages/werkzeug/serving.py", line 328, in execute write(b"") File "python/plugin_document-question-answering_managed/lib/python/site-packages/werkzeug/serving.py", line 253, in write assert status_set is not None, "write() before start_response"AssertionError: write() before start_response

The same setup works fine with ChatGPT series (all of them).

---

Operating system used: Windows 11