prompt-gemma-like-a-pro.ipynb

{"cells":[{"source":"<a href=\"https://www.kaggle.com/code/gpreda/prompt-gemma-like-a-pro?scriptVersionId=173482550\" target=\"_blank\"><img align=\"left\" alt=\"Kaggle\" title=\"Open in Kaggle\" src=\"https://kaggle.com/static/images/open-in-kaggle.svg\"></a>","metadata":{},"cell_type":"markdown"},{"cell_type":"markdown","id":"32406cfd","metadata":{"papermill":{"duration":0.01659,"end_time":"2024-04-23T07:22:44.415796","exception":false,"start_time":"2024-04-23T07:22:44.399206","status":"completed"},"tags":[]},"source":["<center><img src=\"https://res.infoq.com/news/2024/02/google-gemma-open-model/en/headerimage/generatedHeaderImage-1708977571481.jpg\" width=\"400\"></center>\n","\n","# Introduction \n","\n","This Notebook is just for me to check a bit Gemma model. \n","Will just load Gemma and demonstrate its performance with few tasks:\n","* Simple prompts with general information questions    \n","* Poetry (haiku, sonets) writing  \n","* Code writing (Python, C++, Java)  \n","* Software design (simple problems)  \n","* Multi-parameter questions  \n","* Do it yourself questions  \n","* Chain of reasoning  \n","* A more complex reasoning problem\n","\n","I intend to learn from this experience so that I can then build then someting a bit more complex."]},{"cell_type":"markdown","id":"b9a3d95a","metadata":{"papermill":{"duration":0.015362,"end_time":"2024-04-23T07:22:44.447052","exception":false,"start_time":"2024-04-23T07:22:44.43169","status":"completed"},"tags":[]},"source":["# Install Keras NLP and Keras"]},{"cell_type":"code","execution_count":1,"id":"9f3ec78f","metadata":{"_kg_hide-output":true,"execution":{"iopub.execute_input":"2024-04-23T07:22:44.480628Z","iopub.status.busy":"2024-04-23T07:22:44.480285Z","iopub.status.idle":"2024-04-23T07:23:17.490522Z","shell.execute_reply":"2024-04-23T07:23:17.489486Z"},"papermill":{"duration":33.029248,"end_time":"2024-04-23T07:23:17.493044","exception":false,"start_time":"2024-04-23T07:22:44.463796","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\r\n","tensorflow-decision-forests 1.8.1 requires wurlitzer, which is not installed.\u001b[0m\u001b[31m\r\n","\u001b[0m\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\r\n","tensorflow-decision-forests 1.8.1 requires wurlitzer, which is not installed.\r\n","tensorflow 2.15.0 requires keras<2.16,>=2.15.0, but you have keras 3.3.2 which is incompatible.\u001b[0m\u001b[31m\r\n","\u001b[0m"]}],"source":["!pip install -q -U keras-nlp\n","!pip install -q -U keras>=3"]},{"cell_type":"markdown","id":"c7c01106","metadata":{"papermill":{"duration":0.016261,"end_time":"2024-04-23T07:23:17.525972","exception":false,"start_time":"2024-04-23T07:23:17.509711","status":"completed"},"tags":[]},"source":["# Import packages"]},{"cell_type":"code","execution_count":2,"id":"9e012b05","metadata":{"_kg_hide-output":true,"execution":{"iopub.execute_input":"2024-04-23T07:23:17.56017Z","iopub.status.busy":"2024-04-23T07:23:17.559378Z","iopub.status.idle":"2024-04-23T07:23:33.266834Z","shell.execute_reply":"2024-04-23T07:23:33.266041Z"},"papermill":{"duration":15.727401,"end_time":"2024-04-23T07:23:33.269324","exception":false,"start_time":"2024-04-23T07:23:17.541923","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["2024-04-23 07:23:19.885187: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered\n","2024-04-23 07:23:19.885314: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered\n","2024-04-23 07:23:20.055058: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered\n"]}],"source":["import keras\n","import keras_nlp\n","import os\n","from time import time\n","\n","# Select the desired backend for Keras. Options: \"jax\", \"tensorflow\", or \"torch\".\n","os.environ[\"KERAS_BACKEND\"] = \"jax\"  # Adjust as needed.\n","\n","# Specific to the JAX backend, this setting helps avoid memory fragmentation, ensuring more efficient resource use.\n","os.environ[\"XLA_PYTHON_CLIENT_MEM_FRACTION\"] = \"1.00\""]},{"cell_type":"markdown","id":"93a56ced","metadata":{"papermill":{"duration":0.015586,"end_time":"2024-04-23T07:23:33.301416","exception":false,"start_time":"2024-04-23T07:23:33.28583","status":"completed"},"tags":[]},"source":["# Load Gemma Causal LLM through Keras NLP "]},{"cell_type":"code","execution_count":3,"id":"9966dc67","metadata":{"_kg_hide-output":true,"execution":{"iopub.execute_input":"2024-04-23T07:23:33.334382Z","iopub.status.busy":"2024-04-23T07:23:33.333356Z","iopub.status.idle":"2024-04-23T07:25:01.350965Z","shell.execute_reply":"2024-04-23T07:25:01.34994Z"},"papermill":{"duration":88.036504,"end_time":"2024-04-23T07:25:01.353363","exception":false,"start_time":"2024-04-23T07:23:33.316859","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["Attaching 'config.json' from model 'keras/gemma/keras/gemma_instruct_2b_en/2' to your Kaggle notebook...\n","Attaching 'config.json' from model 'keras/gemma/keras/gemma_instruct_2b_en/2' to your Kaggle notebook...\n","Attaching 'model.weights.h5' from model 'keras/gemma/keras/gemma_instruct_2b_en/2' to your Kaggle notebook...\n","Attaching 'tokenizer.json' from model 'keras/gemma/keras/gemma_instruct_2b_en/2' to your Kaggle notebook...\n","Attaching 'assets/tokenizer/vocabulary.spm' from model 'keras/gemma/keras/gemma_instruct_2b_en/2' to your Kaggle notebook...\n","normalizer.cc(51) LOG(INFO) precompiled_charsmap is empty. use identity normalization.\n"]}],"source":["gemma_lm = keras_nlp.models.GemmaCausalLM.from_preset(\"gemma_instruct_2b_en\")"]},{"cell_type":"markdown","id":"f9b31c87","metadata":{"papermill":{"duration":0.015706,"end_time":"2024-04-23T07:25:01.385341","exception":false,"start_time":"2024-04-23T07:25:01.369635","status":"completed"},"tags":[]},"source":["# Check Gemma parameters"]},{"cell_type":"code","execution_count":4,"id":"895d37fb","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:01.418362Z","iopub.status.busy":"2024-04-23T07:25:01.418055Z","iopub.status.idle":"2024-04-23T07:25:01.449722Z","shell.execute_reply":"2024-04-23T07:25:01.448892Z"},"papermill":{"duration":0.050547,"end_time":"2024-04-23T07:25:01.451768","exception":false,"start_time":"2024-04-23T07:25:01.401221","status":"completed"},"tags":[]},"outputs":[{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\">Preprocessor: \"gemma_causal_lm_preprocessor\"</span>\n","</pre>\n"],"text/plain":["\u001b[1mPreprocessor: \"gemma_causal_lm_preprocessor\"\u001b[0m\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃<span style=\"font-weight: bold\"> Tokenizer (type)                                   </span>┃<span style=\"font-weight: bold\">                                             Vocab # </span>┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ gemma_tokenizer (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">GemmaTokenizer</span>)                   │                                             <span style=\"color: #00af00; text-decoration-color: #00af00\">256,000</span> │\n","└────────────────────────────────────────────────────┴─────────────────────────────────────────────────────┘\n","</pre>\n"],"text/plain":["┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃\u001b[1m \u001b[0m\u001b[1mTokenizer (type)                                  \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1m                                            Vocab #\u001b[0m\u001b[1m \u001b[0m┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ gemma_tokenizer (\u001b[38;5;33mGemmaTokenizer\u001b[0m)                   │                                             \u001b[38;5;34m256,000\u001b[0m │\n","└────────────────────────────────────────────────────┴─────────────────────────────────────────────────────┘\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\">Model: \"gemma_causal_lm\"</span>\n","</pre>\n"],"text/plain":["\u001b[1mModel: \"gemma_causal_lm\"\u001b[0m\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃<span style=\"font-weight: bold\"> Layer (type)                  </span>┃<span style=\"font-weight: bold\"> Output Shape              </span>┃<span style=\"font-weight: bold\">         Param # </span>┃<span style=\"font-weight: bold\"> Connected to               </span>┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ padding_mask (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">InputLayer</span>)     │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>)              │               <span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_ids (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">InputLayer</span>)        │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>)              │               <span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ gemma_backbone                │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00af00; text-decoration-color: #00af00\">2048</span>)        │   <span style=\"color: #00af00; text-decoration-color: #00af00\">2,506,172,416</span> │ padding_mask[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>],        │\n","│ (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">GemmaBackbone</span>)               │                           │                 │ token_ids[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>]            │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_embedding               │ (<span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00d7ff; text-decoration-color: #00d7ff\">None</span>, <span style=\"color: #00af00; text-decoration-color: #00af00\">256000</span>)      │     <span style=\"color: #00af00; text-decoration-color: #00af00\">524,288,000</span> │ gemma_backbone[<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>][<span style=\"color: #00af00; text-decoration-color: #00af00\">0</span>]       │\n","│ (<span style=\"color: #0087ff; text-decoration-color: #0087ff\">ReversibleEmbedding</span>)         │                           │                 │                            │\n","└───────────────────────────────┴───────────────────────────┴─────────────────┴────────────────────────────┘\n","</pre>\n"],"text/plain":["┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓\n","┃\u001b[1m \u001b[0m\u001b[1mLayer (type)                 \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mOutput Shape             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1m        Param #\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mConnected to              \u001b[0m\u001b[1m \u001b[0m┃\n","┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩\n","│ padding_mask (\u001b[38;5;33mInputLayer\u001b[0m)     │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m)              │               \u001b[38;5;34m0\u001b[0m │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_ids (\u001b[38;5;33mInputLayer\u001b[0m)        │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m)              │               \u001b[38;5;34m0\u001b[0m │ -                          │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ gemma_backbone                │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m, \u001b[38;5;34m2048\u001b[0m)        │   \u001b[38;5;34m2,506,172,416\u001b[0m │ padding_mask[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m],        │\n","│ (\u001b[38;5;33mGemmaBackbone\u001b[0m)               │                           │                 │ token_ids[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m]            │\n","├───────────────────────────────┼───────────────────────────┼─────────────────┼────────────────────────────┤\n","│ token_embedding               │ (\u001b[38;5;45mNone\u001b[0m, \u001b[38;5;45mNone\u001b[0m, \u001b[38;5;34m256000\u001b[0m)      │     \u001b[38;5;34m524,288,000\u001b[0m │ gemma_backbone[\u001b[38;5;34m0\u001b[0m][\u001b[38;5;34m0\u001b[0m]       │\n","│ (\u001b[38;5;33mReversibleEmbedding\u001b[0m)         │                           │                 │                            │\n","└───────────────────────────────┴───────────────────────────┴─────────────────┴────────────────────────────┘\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Total params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">2,506,172,416</span> (9.34 GB)\n","</pre>\n"],"text/plain":["\u001b[1m Total params: \u001b[0m\u001b[38;5;34m2,506,172,416\u001b[0m (9.34 GB)\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Trainable params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">2,506,172,416</span> (9.34 GB)\n","</pre>\n"],"text/plain":["\u001b[1m Trainable params: \u001b[0m\u001b[38;5;34m2,506,172,416\u001b[0m (9.34 GB)\n"]},"metadata":{},"output_type":"display_data"},{"data":{"text/html":["<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-weight: bold\"> Non-trainable params: </span><span style=\"color: #00af00; text-decoration-color: #00af00\">0</span> (0.00 B)\n","</pre>\n"],"text/plain":["\u001b[1m Non-trainable params: \u001b[0m\u001b[38;5;34m0\u001b[0m (0.00 B)\n"]},"metadata":{},"output_type":"display_data"}],"source":["gemma_lm.summary()"]},{"cell_type":"markdown","id":"9b2f794d","metadata":{"papermill":{"duration":0.016937,"end_time":"2024-04-23T07:25:01.485498","exception":false,"start_time":"2024-04-23T07:25:01.468561","status":"completed"},"tags":[]},"source":["# Define and run a simple prompt (geography question)"]},{"cell_type":"code","execution_count":5,"id":"08beab76","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:01.524275Z","iopub.status.busy":"2024-04-23T07:25:01.523929Z","iopub.status.idle":"2024-04-23T07:25:30.403525Z","shell.execute_reply":"2024-04-23T07:25:30.402318Z"},"papermill":{"duration":28.901376,"end_time":"2024-04-23T07:25:30.405731","exception":false,"start_time":"2024-04-23T07:25:01.504355","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["WARNING: All log messages before absl::InitializeLog() is called are written to STDERR\n","I0000 00:00:1713857128.721219      26 device_compiler.h:186] Compiled cluster using XLA!  This line is logged at most once for the lifetime of the process.\n","W0000 00:00:1713857128.792540      26 graph_launch.cc:671] Fallback to op-by-op mode because memset node breaks graph update\n","W0000 00:00:1713857129.125149      26 graph_launch.cc:671] Fallback to op-by-op mode because memset node breaks graph update\n"]},{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","Question: What is the surface temperature of the Moon?\n","Answer:\n","The surface temperature of the Moon is extremely cold, with an average temperature of -173°C (-283°F).\n"]}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","Question: {question}\n","Answer:\n","\"\"\"\n","response = gemma_lm.generate(prompt.format(question=\"What is the surface temperature of the Moon?\"), max_length=256)\n","print(response)"]},{"cell_type":"markdown","id":"b7c8dd56","metadata":{"papermill":{"duration":0.01726,"end_time":"2024-04-23T07:25:30.440786","exception":false,"start_time":"2024-04-23T07:25:30.423526","status":"completed"},"tags":[]},"source":["# Format the output "]},{"cell_type":"code","execution_count":6,"id":"09882446","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:30.476775Z","iopub.status.busy":"2024-04-23T07:25:30.475866Z","iopub.status.idle":"2024-04-23T07:25:30.4814Z","shell.execute_reply":"2024-04-23T07:25:30.480665Z"},"papermill":{"duration":0.025467,"end_time":"2024-04-23T07:25:30.483295","exception":false,"start_time":"2024-04-23T07:25:30.457828","status":"completed"},"tags":[]},"outputs":[],"source":["from IPython.display import display, Markdown\n","\n","def colorize_text(text):\n","    for word, color in zip([\"Reasoning\", \"Question\", \"Answer\", \"Total time\"], [\"blue\", \"red\", \"green\", \"magenta\"]):\n","        text = text.replace(f\"{word}:\", f\"\\n\\n**<font color='{color}'>{word}:</font>**\")\n","    return text"]},{"cell_type":"code","execution_count":7,"id":"b7b1d77b","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:30.518137Z","iopub.status.busy":"2024-04-23T07:25:30.517842Z","iopub.status.idle":"2024-04-23T07:25:31.968865Z","shell.execute_reply":"2024-04-23T07:25:31.967895Z"},"papermill":{"duration":1.471044,"end_time":"2024-04-23T07:25:31.971179","exception":false,"start_time":"2024-04-23T07:25:30.500135","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** What is the surface temperature of the Moon?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The surface temperature of the Moon is extremely cold, with an average temperature of -173°C (-283°F).\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.44 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"What is the surface temperature of the Moon?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"2e5e66b7","metadata":{"papermill":{"duration":0.017688,"end_time":"2024-04-23T07:25:32.006786","exception":false,"start_time":"2024-04-23T07:25:31.989098","status":"completed"},"tags":[]},"source":["# More such questions\n","\n","Make sure he is really confused. He doesn't know European, ancient World or Japanese history."]},{"cell_type":"code","execution_count":8,"id":"9b0ec826","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:32.043339Z","iopub.status.busy":"2024-04-23T07:25:32.042988Z","iopub.status.idle":"2024-04-23T07:25:33.414589Z","shell.execute_reply":"2024-04-23T07:25:33.413458Z"},"papermill":{"duration":1.392615,"end_time":"2024-04-23T07:25:33.416952","exception":false,"start_time":"2024-04-23T07:25:32.024337","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** When was the 30 years war?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The context does not provide any information about the 30 years war, so I cannot answer this question from the provided context.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.36 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"When was the 30 years war?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":9,"id":"354ca5af","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:33.454304Z","iopub.status.busy":"2024-04-23T07:25:33.453976Z","iopub.status.idle":"2024-04-23T07:25:34.707505Z","shell.execute_reply":"2024-04-23T07:25:34.706398Z"},"papermill":{"duration":1.274385,"end_time":"2024-04-23T07:25:34.709984","exception":false,"start_time":"2024-04-23T07:25:33.435599","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** What is a graphe paranomon?\n","\n","\n","**<font color='green'>Answer:</font>**\n","A graphe paranomon is a type of graph that is used to model a relationship between two sets of objects.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.25 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t= time()\n","response = gemma_lm.generate(prompt.format(question=\"What is a graphe paranomon?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":10,"id":"4f819e21","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:34.753704Z","iopub.status.busy":"2024-04-23T07:25:34.753377Z","iopub.status.idle":"2024-04-23T07:25:36.132497Z","shell.execute_reply":"2024-04-23T07:25:36.13135Z"},"papermill":{"duration":1.402875,"end_time":"2024-04-23T07:25:36.135021","exception":false,"start_time":"2024-04-23T07:25:34.732146","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** Who was the next shogon after Yeiatsu Tokugawa?\n","\n","\n","**<font color='green'>Answer:</font>**\n","I am unable to provide specific information about the next shogun, as I do not have access to real-time or comprehensive data.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.37 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Who was the next shogon after Yeiatsu Tokugawa?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"fe262e02","metadata":{"papermill":{"duration":0.058797,"end_time":"2024-04-23T07:25:36.214365","exception":false,"start_time":"2024-04-23T07:25:36.155568","status":"completed"},"tags":[]},"source":["Obviously, this model doesn't know post-grad world history. Let's test it with some junior-high level American history."]},{"cell_type":"code","execution_count":11,"id":"0ca00e23","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:36.253706Z","iopub.status.busy":"2024-04-23T07:25:36.252522Z","iopub.status.idle":"2024-04-23T07:25:38.081875Z","shell.execute_reply":"2024-04-23T07:25:38.080824Z"},"papermill":{"duration":1.851233,"end_time":"2024-04-23T07:25:38.083988","exception":false,"start_time":"2024-04-23T07:25:36.232755","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** Who was the first American president?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The first American president was George Washington.\n","\n","Explanation: George Washington served as the first President of the United States of America from 1789 to 1797.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.82 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Who was the first American president?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"9ca088f6","metadata":{"papermill":{"duration":0.018426,"end_time":"2024-04-23T07:25:38.121362","exception":false,"start_time":"2024-04-23T07:25:38.102936","status":"completed"},"tags":[]},"source":["Looks like it nailed it. Let's try something more difficult."]},{"cell_type":"code","execution_count":12,"id":"1b093fac","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:38.160791Z","iopub.status.busy":"2024-04-23T07:25:38.160463Z","iopub.status.idle":"2024-04-23T07:25:39.461825Z","shell.execute_reply":"2024-04-23T07:25:39.460837Z"},"papermill":{"duration":1.323701,"end_time":"2024-04-23T07:25:39.464171","exception":false,"start_time":"2024-04-23T07:25:38.14047","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer simple questions.\n","Please restrict your answer to the exact question asked.\n","Think step by step, use careful reasoning.\n","\n","\n","**<font color='red'>Question:</font>** When took place the Civil War in United States of America?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The Civil War in the United States of America took place from 1861 to 1865.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.3 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"When took place the Civil War in United States of America?\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"70ba6069","metadata":{"papermill":{"duration":0.018016,"end_time":"2024-04-23T07:25:39.502674","exception":false,"start_time":"2024-04-23T07:25:39.484658","status":"completed"},"tags":[]},"source":["# Let's write poetry"]},{"cell_type":"code","execution_count":13,"id":"8b385839","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:39.541015Z","iopub.status.busy":"2024-04-23T07:25:39.540694Z","iopub.status.idle":"2024-04-23T07:25:40.880691Z","shell.execute_reply":"2024-04-23T07:25:40.879663Z"},"papermill":{"duration":1.361787,"end_time":"2024-04-23T07:25:40.88315","exception":false,"start_time":"2024-04-23T07:25:39.521363","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 words poems).\n","Question: Please write a poem about Boris Becker wins in tennis\n","Answer:\n","Racket's fierce dance,\n","Boris's strokes, a graceful gleam,\n","Champion's roar ascends.\n"]},{"data":{"text/markdown":["\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.33 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 words poems).\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a poem about Boris Becker wins in tennis\"), max_length=256)\n","print(response)\n","display(Markdown(colorize_text(f\"\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"b058a67b","metadata":{"papermill":{"duration":0.018893,"end_time":"2024-04-23T07:25:40.92055","exception":false,"start_time":"2024-04-23T07:25:40.901657","status":"completed"},"tags":[]},"source":["OK, let's try something else."]},{"cell_type":"code","execution_count":14,"id":"7fbc2e12","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:40.958491Z","iopub.status.busy":"2024-04-23T07:25:40.958048Z","iopub.status.idle":"2024-04-23T07:25:42.135795Z","shell.execute_reply":"2024-04-23T07:25:42.134811Z"},"papermill":{"duration":1.199189,"end_time":"2024-04-23T07:25:42.137723","exception":false,"start_time":"2024-04-23T07:25:40.938534","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 words poems).\n","Question: Please write a poem about Shakespeare being lame at playing poker\n","Answer:\n","Words tumble slow,\n","Shakespeare's hand, a sorry sight,\n","Bluffing with a sigh.\n"]},{"data":{"text/markdown":["\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.17 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write poetry.\n","Please answer with a haiku format (17 words poems).\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a poem about Shakespeare being lame at playing poker\"), max_length=256)\n","print(response)\n","display(Markdown(colorize_text(f\"\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"62b6bd5e","metadata":{"papermill":{"duration":0.018794,"end_time":"2024-04-23T07:25:42.176187","exception":false,"start_time":"2024-04-23T07:25:42.157393","status":"completed"},"tags":[]},"source":["One more, a bit more difficult."]},{"cell_type":"code","execution_count":15,"id":"3cd02a90","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:42.215209Z","iopub.status.busy":"2024-04-23T07:25:42.214839Z","iopub.status.idle":"2024-04-23T07:25:49.319235Z","shell.execute_reply":"2024-04-23T07:25:49.318235Z"},"papermill":{"duration":7.126194,"end_time":"2024-04-23T07:25:49.321169","exception":false,"start_time":"2024-04-23T07:25:42.194975","status":"completed"},"tags":[]},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","You are an AI assistant designed to write poetry.\n","Please answer with a short poem, with rime, in the style of Shakespeare's poems.\n","Question: Please write a 10 verses about Nadia Comaneci winning Montreal Olympiad\n","Answer:\n","In Montreal's realm, where dreams take flight,\n","A legend's tale, a radiant light.\n","Nadia's grace, a dance so divine,\n","With every stroke, a symphony divine.\n","\n","Her strokes, a tapestry of grace and might,\n","A canvas where beauty takes flight.\n","With every move, she paints a vibrant scene,\n","A masterpiece that's sure to remain.\n","\n","Her spirit shines, a beacon in the night,\n","A champion's spirit, shining bright.\n","In every stroke, she finds her bliss,\n","A testament to her unwavering kiss.\n","\n","Her talent shines, a gift from above,\n","A muse of art, a story to be told.\n","In Montreal's heart, her spirit takes flight,\n","A legend's rise, a shining light.\n"]},{"data":{"text/markdown":["\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 7.1 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write poetry.\n","Please answer with a short poem, with rime, in the style of Shakespeare's poems.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a 10 verses about Nadia Comaneci winning Montreal Olympiad\"), max_length=256)\n","print(response)\n","display(Markdown(colorize_text(f\"\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"e13b487e","metadata":{"papermill":{"duration":0.019741,"end_time":"2024-04-23T07:25:49.360127","exception":false,"start_time":"2024-04-23T07:25:49.340386","status":"completed"},"tags":[]},"source":["# Math problems and Python code"]},{"cell_type":"code","execution_count":16,"id":"6a8fa326","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:49.40106Z","iopub.status.busy":"2024-04-23T07:25:49.400705Z","iopub.status.idle":"2024-04-23T07:25:53.419854Z","shell.execute_reply":"2024-04-23T07:25:53.418772Z"},"papermill":{"duration":4.041957,"end_time":"2024-04-23T07:25:53.422012","exception":false,"start_time":"2024-04-23T07:25:49.380055","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Python to calculate the area of a circle of radius r\n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","def area_of_circle(radius):\n","  \"\"\"\n","  Calculates the area of a circle of radius r.\n","\n","  Args:\n","    radius: The radius of the circle in meters.\n","\n","  Returns:\n","    The area of the circle in square meters.\n","  \"\"\"\n","\n","  # Calculate the area of the circle.\n","  area = math.pi * radius ** 2\n","\n","  return area\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.01 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Python to calculate the area of a circle of radius r\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"29e46b9f","metadata":{"papermill":{"duration":0.019929,"end_time":"2024-04-23T07:25:53.462686","exception":false,"start_time":"2024-04-23T07:25:53.442757","status":"completed"},"tags":[]},"source":["## Let's test more Python"]},{"cell_type":"code","execution_count":17,"id":"412e8e4f","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:53.506228Z","iopub.status.busy":"2024-04-23T07:25:53.505506Z","iopub.status.idle":"2024-04-23T07:25:58.630975Z","shell.execute_reply":"2024-04-23T07:25:58.630104Z"},"papermill":{"duration":5.148859,"end_time":"2024-04-23T07:25:58.633156","exception":false,"start_time":"2024-04-23T07:25:53.484297","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Python to order a list\n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","def order_list(list1):\n","  \"\"\"\n","  Orders a list in ascending order.\n","\n","  Args:\n","    list1: The list to order.\n","\n","  Returns:\n","    The ordered list.\n","  \"\"\"\n","\n","  # Sort the list in ascending order.\n","  list1.sort()\n","\n","  return list1\n","\n","\n","# Example usage.\n","list1 = [5, 2, 8, 1, 9]\n","ordered_list = order_list(list1)\n","print(ordered_list)\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 5.12 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Python to order a list\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"1bf5932f","metadata":{"papermill":{"duration":0.019842,"end_time":"2024-04-23T07:25:58.673526","exception":false,"start_time":"2024-04-23T07:25:58.653684","status":"completed"},"tags":[]},"source":["# Software design"]},{"cell_type":"code","execution_count":18,"id":"eb2801a3","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:25:58.715053Z","iopub.status.busy":"2024-04-23T07:25:58.714737Z","iopub.status.idle":"2024-04-23T07:26:47.980427Z","shell.execute_reply":"2024-04-23T07:26:47.9793Z"},"papermill":{"duration":49.289034,"end_time":"2024-04-23T07:26:47.982569","exception":false,"start_time":"2024-04-23T07:25:58.693535","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["W0000 00:00:1713857187.982677      26 graph_launch.cc:671] Fallback to op-by-op mode because memset node breaks graph update\n","W0000 00:00:1713857189.046426      26 graph_launch.cc:671] Fallback to op-by-op mode because memset node breaks graph update\n"]},{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a class in Python \n","                        to model a phone book (storing name, surname, address, phone) \n","                        with add, delete, order by name, search operations.\n","                        The class should store a list of contacts, each\n","                        with name, surname, address, phone information stored.\n","                        \n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","class PhoneBook:\n","\n","    def __init__(self, contacts):\n","        self.contacts = contacts\n","\n","    def add(self, name, surname, address, phone):\n","        self.contacts.append({\"name\": name, \"surname\": surname, \"address\": address, \"phone\": phone})\n","\n","    def delete(self, name):\n","        for contact in self.contacts:\n","            if contact[\"name\"] == name:\n","                self.contacts.remove(contact)\n","                return True\n","\n","    def order_by_name(self):\n","        self.contacts.sort(key=lambda x: x[\"name\"])\n","\n","    def search(self, name):\n","        for contact in self.contacts:\n","            if contact[\"name\"] == name:\n","                return contact\n","\n","# Create a phone book with some contacts\n","phone_book = PhoneBook([\n","    {\"name\": \"John Smith\", \"surname\": \"Doe\", \"address\": \"123 Main Street\", \"phone\": \"555-123-4567\"},\n","    {\"name\": \"Jane Doe\", \"surname\": \"Smith\", \"address\": \"456 Elm Street\", \"phone\": \"555-234-5678\"},\n","    {\"name\": \"Peter Parker\", \"surname\": \"Parker\", \"address\": \"789 Oak Street\", \"phone\": \"555-345-6789\"},\n","])\n","\n","# Add some contacts to the phone book\n","phone_book.add(\"Mary Johnson\", \"Williams\", \"101 Main Street\", \"555-567-8901\")\n","phone_book.add(\"David Lee\", \"Anderson\", \"202 Elm Street\", \"555-678-9012\")\n","\n","# Delete a contact from the phone book\n","phone_book.delete(\"John Smith\")\n","\n","# Order the contacts by name\n","phone_book.order_by_name()\n","\n","# Search for a contact by name\n","print(phone_book.search(\"Jane Doe\"))\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 49.26 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","            question=\"\"\"Please write a class in Python \n","                        to model a phone book (storing name, surname, address, phone) \n","                        with add, delete, order by name, search operations.\n","                        The class should store a list of contacts, each\n","                        with name, surname, address, phone information stored.\n","                        \"\"\"), \n","            max_length=1024)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":19,"id":"51b1edff","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:26:48.024255Z","iopub.status.busy":"2024-04-23T07:26:48.023909Z","iopub.status.idle":"2024-04-23T07:27:25.9195Z","shell.execute_reply":"2024-04-23T07:27:25.918517Z"},"papermill":{"duration":37.939857,"end_time":"2024-04-23T07:27:25.942879","exception":false,"start_time":"2024-04-23T07:26:48.003022","status":"completed"},"tags":[]},"outputs":[{"name":"stderr","output_type":"stream","text":["W0000 00:00:1713857235.597313      26 graph_launch.cc:671] Fallback to op-by-op mode because memset node breaks graph update\n"]},{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Python code.\n","Please answer with the listing of the Python code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a small Python module that creates a REST API service\n","                        with two endpoints: \n","                        * get_status (GET)\n","                        * prediction (POST)\n","                        The prediction endpoint receives the payload, extract three fields: city, street and number\n","                        and returns a field called price_estimate\n","                        \n","                        \n","\n","\n","**<font color='green'>Answer:</font>**\n","```python\n","import json\n","\n","# Define the API endpoint\n","app = flask.Flask(__name__)\n","\n","# Define the GET endpoint\n","@app.route(\"/get_status\", methods=[\"GET\"])\n","def get_status():\n","    # Return a simple response\n","    return {\"message\": \"OK\"}\n","\n","# Define the POST endpoint\n","@app.route(\"/prediction\", methods=[\"POST\"])\n","def prediction():\n","    # Get the payload\n","    data = request.get_json()\n","\n","    # Extract the city, street and number fields from the payload\n","    city = data[\"city\"]\n","    street = data[\"street\"]\n","    number = data[\"number\"]\n","\n","    # Calculate the price estimate\n","    price_estimate = calculate_price(city, street, number)\n","\n","    # Return the price estimate in the response\n","    return {\"price_estimate\": price_estimate}\n","\n","\n","# Define the calculate_price function\n","def calculate_price(city, street, number):\n","    # Implement the logic to calculate the price estimate\n","    return price_estimate\n","\n","\n","# Run the Flask app\n","app.run()\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 37.89 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","\n","response = gemma_lm.generate(prompt.format(\n","            question=\"\"\"Please write a small Python module that creates a REST API service\n","                        with two endpoints: \n","                        * get_status (GET)\n","                        * prediction (POST)\n","                        The prediction endpoint receives the payload, extract three fields: city, street and number\n","                        and returns a field called price_estimate\n","                        \n","                        \"\"\"), \n","            max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"987780e0","metadata":{"papermill":{"duration":0.02112,"end_time":"2024-04-23T07:27:25.985435","exception":false,"start_time":"2024-04-23T07:27:25.964315","status":"completed"},"tags":[]},"source":["# C++ code"]},{"cell_type":"code","execution_count":20,"id":"1d56b49f","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:27:26.029673Z","iopub.status.busy":"2024-04-23T07:27:26.028942Z","iopub.status.idle":"2024-04-23T07:27:33.774108Z","shell.execute_reply":"2024-04-23T07:27:33.773041Z"},"papermill":{"duration":7.769924,"end_time":"2024-04-23T07:27:33.776494","exception":false,"start_time":"2024-04-23T07:27:26.00657","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to calculate the area of a circle of radius r\n","\n","\n","**<font color='green'>Answer:</font>**\n","```c++\n","#include <iostream>\n","#include <cmath>\n","\n","using namespace std;\n","\n","double area_of_circle(double radius) {\n","  // Calculate the area of the circle\n","  double area = M_PI * radius * radius;\n","\n","  // Return the area of the circle\n","  return area;\n","}\n","\n","int main() {\n","  // Get the radius of the circle from the user\n","  double radius;\n","  cout << \"Enter the radius of the circle: \";\n","  cin >> radius;\n","\n","  // Calculate the area of the circle\n","  double area = area_of_circle(radius);\n","\n","  // Print the area of the circle\n","  cout << \"The area of the circle is: \" << area << \" square units\" << endl;\n","\n","  return 0;\n","}\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 7.74 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to calculate the area of a circle of radius r\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":21,"id":"f664176a","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:27:33.822253Z","iopub.status.busy":"2024-04-23T07:27:33.821911Z","iopub.status.idle":"2024-04-23T07:27:41.791001Z","shell.execute_reply":"2024-04-23T07:27:41.789974Z"},"papermill":{"duration":7.993002,"end_time":"2024-04-23T07:27:41.793068","exception":false,"start_time":"2024-04-23T07:27:33.800066","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to calculate the volume of a cylinder with radius r and height h\n","\n","\n","**<font color='green'>Answer:</font>**\n","```c++\n","#include <iostream>\n","#include <cmath>\n","\n","using namespace std;\n","\n","double cylinderVolume(double radius, double height) {\n","  // Calculate the volume of the cylinder\n","  double volume = M_PI * radius * height;\n","\n","  return volume;\n","}\n","\n","int main() {\n","  // Get the radius and height of the cylinder from the user\n","  double radius, height;\n","  cout << \"Enter the radius of the cylinder: \";\n","  cin >> radius;\n","  cout << \"Enter the height of the cylinder: \";\n","  cin >> height;\n","\n","  // Calculate and print the volume of the cylinder\n","  double volume = cylinderVolume(radius, height);\n","  cout << \"The volume of the cylinder is: \" << volume << \" cubic units\" << endl;\n","\n","  return 0;\n","}\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 7.96 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to calculate the volume of a cylinder with radius r and height h\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":22,"id":"02bd1328","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:27:41.835697Z","iopub.status.busy":"2024-04-23T07:27:41.835401Z","iopub.status.idle":"2024-04-23T07:27:51.74698Z","shell.execute_reply":"2024-04-23T07:27:51.745959Z"},"papermill":{"duration":9.935563,"end_time":"2024-04-23T07:27:51.749207","exception":false,"start_time":"2024-04-23T07:27:41.813644","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple C++ code.\n","Please answer with the listing of the C++ code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in C++ to order a list\n","\n","\n","**<font color='green'>Answer:</font>**\n","```c++\n","#include <iostream>\n","#include <vector>\n","\n","using namespace std;\n","\n","void orderList(vector<int> &nums) {\n","  // Bubble sort the list in ascending order\n","  for (int i = 0; i < nums.size(); i++) {\n","    for (int j = 0; j < nums.size() - i - 1; j++) {\n","      if (nums[j] > nums[j + 1]) {\n","        swap(nums[j], nums[j + 1]);\n","      }\n","    }\n","  }\n","\n","  // Print the ordered list\n","  for (int num : nums) {\n","    cout << num << \" \";\n","  }\n","  cout << endl;\n","}\n","\n","int main() {\n","  // Create a list of integers\n","  vector<int> nums = {5, 2, 8, 3, 1};\n","\n","  // Call the orderList function\n","  orderList(nums);\n","\n","  return 0;\n","}\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 9.91 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in C++ to order a list\"), max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"53b5aa45","metadata":{"papermill":{"duration":0.022342,"end_time":"2024-04-23T07:27:51.794311","exception":false,"start_time":"2024-04-23T07:27:51.771969","status":"completed"},"tags":[]},"source":["# Java code"]},{"cell_type":"code","execution_count":23,"id":"c80053ec","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:27:51.841046Z","iopub.status.busy":"2024-04-23T07:27:51.840172Z","iopub.status.idle":"2024-04-23T07:27:58.064033Z","shell.execute_reply":"2024-04-23T07:27:58.062934Z"},"papermill":{"duration":6.249702,"end_time":"2024-04-23T07:27:58.066188","exception":false,"start_time":"2024-04-23T07:27:51.816486","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Java code.\n","Please answer with the listing of the Java code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Java to calculate the area of a circle of radius r\n","\n","\n","**<font color='green'>Answer:</font>**\n","```java\n","public class CircleArea {\n","\n","    public static double calculateArea(double radius) {\n","        // Calculate the area of a circle\n","        double area = Math.PI * radius * radius;\n","        return area;\n","    }\n","\n","    public static void main(String[] args) {\n","        // Get the radius of the circle from the user\n","        double radius = Double.parseDouble(args[0]);\n","\n","        // Calculate the area of the circle\n","        double area = calculateArea(radius);\n","\n","        // Print the area of the circle\n","        System.out.println(\"The area of the circle is: \" + area);\n","    }\n","}\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.22 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to write simple Java code.\n","Please answer with the listing of the Java code.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Java to calculate the area of a circle of radius r\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":24,"id":"68ed5ae3","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:27:58.111495Z","iopub.status.busy":"2024-04-23T07:27:58.111169Z","iopub.status.idle":"2024-04-23T07:28:04.961336Z","shell.execute_reply":"2024-04-23T07:28:04.96038Z"},"papermill":{"duration":6.87476,"end_time":"2024-04-23T07:28:04.963419","exception":false,"start_time":"2024-04-23T07:27:58.088659","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Java code.\n","Please answer with the listing of the Java code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Java to calculate the volume of a cylinder with radius r and height h\n","\n","\n","**<font color='green'>Answer:</font>**\n","```java\n","public class Cylinder {\n","\n","    public static double calculateVolume(double radius, double height) {\n","        // Calculate the volume of a cylinder\n","        double volume = Math.PI * radius * height;\n","        return volume;\n","    }\n","\n","    public static void main(String[] args) {\n","        // Get the radius and height of the cylinder\n","        double radius = Double.parseDouble(args[0]);\n","        double height = Double.parseDouble(args[1]);\n","\n","        // Calculate the volume of the cylinder\n","        double volume = calculateVolume(radius, height);\n","\n","        // Print the volume of the cylinder\n","        System.out.println(\"The volume of the cylinder is: \" + volume);\n","    }\n","}\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 6.84 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Java to calculate the volume of a cylinder with radius r and height h\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"code","execution_count":25,"id":"646dbe0c","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:05.007203Z","iopub.status.busy":"2024-04-23T07:28:05.006882Z","iopub.status.idle":"2024-04-23T07:28:09.131067Z","shell.execute_reply":"2024-04-23T07:28:09.130044Z"},"papermill":{"duration":4.148669,"end_time":"2024-04-23T07:28:09.13339","exception":false,"start_time":"2024-04-23T07:28:04.984721","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to write simple Java code.\n","Please answer with the listing of the Java code.\n","\n","\n","**<font color='red'>Question:</font>** Please write a function in Java to order a list\n","\n","\n","**<font color='green'>Answer:</font>**\n","```java\n","import java.util.*;\n","\n","public class OrderList {\n","\n","    public static void main(String[] args) {\n","        List<String> names = Arrays.asList(\"John\", \"Mary\", \"Bob\", \"Alice\");\n","        Collections.sort(names);\n","        System.out.println(names);\n","    }\n","}\n","```\n","\n","Output:\n","\n","```\n","[Alice, Bob, John, Mary]\n","```\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 4.12 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(question=\"Please write a function in Java to order a list\"), max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"d33287f7","metadata":{"papermill":{"duration":0.022467,"end_time":"2024-04-23T07:28:09.178378","exception":false,"start_time":"2024-04-23T07:28:09.155911","status":"completed"},"tags":[]},"source":["# Multiple parameters questions\n","\n","I create here a prompt with multiple parameters and I ask a variety of questions."]},{"cell_type":"markdown","id":"6b2f116a","metadata":{"papermill":{"duration":0.022331,"end_time":"2024-04-23T07:28:09.222482","exception":false,"start_time":"2024-04-23T07:28:09.200151","status":"completed"},"tags":[]},"source":["## Best food in France"]},{"cell_type":"code","execution_count":26,"id":"fd2ca78f","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:09.269024Z","iopub.status.busy":"2024-04-23T07:28:09.268665Z","iopub.status.idle":"2024-04-23T07:28:10.152715Z","shell.execute_reply":"2024-04-23T07:28:10.151689Z"},"papermill":{"duration":0.90999,"end_time":"2024-04-23T07:28:10.155223","exception":false,"start_time":"2024-04-23T07:28:09.245233","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the best 3 food from France?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- Croque monsieur\n","- Steak frites\n","- Crème brûlée"],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","Question: What are the {adjective} {number} {items} from {place}?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"best\",\n","    number=\"3\",\n","    items=\"food\",\n","    place=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"markdown","id":"2e44ca54","metadata":{"papermill":{"duration":0.023356,"end_time":"2024-04-23T07:28:10.202185","exception":false,"start_time":"2024-04-23T07:28:10.178829","status":"completed"},"tags":[]},"source":["## Best attractions in Italy"]},{"cell_type":"code","execution_count":27,"id":"74aff241","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:10.251301Z","iopub.status.busy":"2024-04-23T07:28:10.250529Z","iopub.status.idle":"2024-04-23T07:28:11.639823Z","shell.execute_reply":"2024-04-23T07:28:11.638757Z"},"papermill":{"duration":1.41643,"end_time":"2024-04-23T07:28:11.641827","exception":false,"start_time":"2024-04-23T07:28:10.225397","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the best five attractions from Italy?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- The Colosseum\n","- The Vatican City\n","- The Trevi Fountain\n","- The Duomo\n","- The Uffizi Gallery\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.38 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"best\",\n","    number=\"five\",\n","    items=\"attractions\",\n","    place=\"Italy\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))                "]},{"cell_type":"markdown","id":"a3f81700","metadata":{"papermill":{"duration":0.023049,"end_time":"2024-04-23T07:28:11.687484","exception":false,"start_time":"2024-04-23T07:28:11.664435","status":"completed"},"tags":[]},"source":["## Most affordable places to retire in Spain"]},{"cell_type":"code","execution_count":28,"id":"1bf0ac1b","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:11.736644Z","iopub.status.busy":"2024-04-23T07:28:11.736289Z","iopub.status.idle":"2024-04-23T07:28:14.686921Z","shell.execute_reply":"2024-04-23T07:28:14.68592Z"},"papermill":{"duration":2.977779,"end_time":"2024-04-23T07:28:14.689204","exception":false,"start_time":"2024-04-23T07:28:11.711425","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the most affordable two places to retire from Spain?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- **Seville**\n","- **Granada**\n","\n","Explanation:\n","\n","- Seville is a city in southern Spain with a lower cost of living compared to other major cities in the country.\n","- Granada is a city in the south of Spain with a lower cost of living compared to other major cities in the country.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 2.94 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"most affordable\",\n","    number=\"two\",\n","    items=\"places to retire\",\n","    place=\"Spain\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"b399354b","metadata":{"papermill":{"duration":0.022555,"end_time":"2024-04-23T07:28:14.734147","exception":false,"start_time":"2024-04-23T07:28:14.711592","status":"completed"},"tags":[]},"source":["## Less known but great places to stay in Romania"]},{"cell_type":"code","execution_count":29,"id":"f2c18a25","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:14.779128Z","iopub.status.busy":"2024-04-23T07:28:14.778784Z","iopub.status.idle":"2024-04-23T07:28:16.117451Z","shell.execute_reply":"2024-04-23T07:28:16.116472Z"},"papermill":{"duration":1.363455,"end_time":"2024-04-23T07:28:16.119973","exception":false,"start_time":"2024-04-23T07:28:14.756518","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the Less known but great 4 places to stay from Romania?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- The Black Sea Coast\n","- The Danube Delta\n","- The Carpathian Mountains\n","- The Bucovina Region\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.33 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"Less known but great\",\n","    number=\"4\",\n","    items=\"places to stay\",\n","    place=\"Romania\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"e1546f2a","metadata":{"papermill":{"duration":0.023756,"end_time":"2024-04-23T07:28:16.170246","exception":false,"start_time":"2024-04-23T07:28:16.14649","status":"completed"},"tags":[]},"source":["## Best commedies by Shakespeare"]},{"cell_type":"code","execution_count":30,"id":"0d052469","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:16.216973Z","iopub.status.busy":"2024-04-23T07:28:16.216355Z","iopub.status.idle":"2024-04-23T07:28:17.229452Z","shell.execute_reply":"2024-04-23T07:28:17.228286Z"},"papermill":{"duration":1.038938,"end_time":"2024-04-23T07:28:17.231503","exception":false,"start_time":"2024-04-23T07:28:16.192565","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the best 3 commedies from Shakespeare entire creation?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- As You Like It\n","- A Midsummer Night's Dream\n","- Macbeth\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.01 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"best\",\n","    number=\"3\",\n","    items=\"commedies\",\n","    place=\"Shakespeare entire creation\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"daf05973","metadata":{"papermill":{"duration":0.021376,"end_time":"2024-04-23T07:28:17.275448","exception":false,"start_time":"2024-04-23T07:28:17.254072","status":"completed"},"tags":[]},"source":["## Most important battles from WW2"]},{"cell_type":"code","execution_count":31,"id":"ef0293d2","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:17.31967Z","iopub.status.busy":"2024-04-23T07:28:17.319357Z","iopub.status.idle":"2024-04-23T07:28:18.86627Z","shell.execute_reply":"2024-04-23T07:28:18.86524Z"},"papermill":{"duration":1.571376,"end_time":"2024-04-23T07:28:18.868428","exception":false,"start_time":"2024-04-23T07:28:17.297052","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions with parameters.\n","Return the answer formated nicely, for example with bullet points.\n","\n","\n","**<font color='red'>Question:</font>** What are the most important 5 battles from WW2?\n","\n","\n","**<font color='green'>Answer:</font>**\n","- Battle of Stalingrad\n","- Battle of Kursk\n","- Battle of Berlin\n","- Battle of D-Day\n","- Battle of Moscow\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 1.54 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    adjective=\"most important\",\n","    number=\"5\",\n","    items=\"battles\",\n","    place=\"WW2\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"14309831","metadata":{"papermill":{"duration":0.022118,"end_time":"2024-04-23T07:28:18.913036","exception":false,"start_time":"2024-04-23T07:28:18.890918","status":"completed"},"tags":[]},"source":["# Do it yourself questions"]},{"cell_type":"code","execution_count":32,"id":"ffc9c806","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:18.957914Z","iopub.status.busy":"2024-04-23T07:28:18.957378Z","iopub.status.idle":"2024-04-23T07:28:28.39701Z","shell.execute_reply":"2024-04-23T07:28:28.395939Z"},"papermill":{"duration":9.464209,"end_time":"2024-04-23T07:28:28.399171","exception":false,"start_time":"2024-04-23T07:28:18.934962","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can build a shelter in the woods, if I have only a saw and a hammer??\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Step 1:** Gather your materials. You will need:\n","\n","- A saw\n","- A hammer\n","- Wood (such as wood boards or pallets)\n","- Nails or screws\n","- A pencil or stake\n","\n","**Step 2:** Prepare the wood. Cut the wood into the following pieces:\n","\n","- A frame (the base of the shelter)\n","- Two walls\n","- A roof\n","\n","**Step 3:** Assemble the frame. Lay the frame pieces flat on the ground and attach them together with nails or screws.\n","\n","**Step 4:** Build the walls. Lay the wall pieces flat on the ground and attach them together with nails or screws.\n","\n","**Step 5:** Build the roof. Lay the roof pieces flat on the frame and attach them together with nails or screws.\n","\n","**Step 6:** Attach the walls and roof to the frame. Use nails or screws to attach the walls and roof to the frame.\n","\n","**Step 7:** Decorate your shelter. You can decorate your shelter with paint, wood stain, or other materials."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","Question: How I can {action}?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"build a shelter in the woods, if I have only a saw and a hammer?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"code","execution_count":33,"id":"67ae673a","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:28.446382Z","iopub.status.busy":"2024-04-23T07:28:28.446084Z","iopub.status.idle":"2024-04-23T07:28:37.112848Z","shell.execute_reply":"2024-04-23T07:28:37.111823Z"},"papermill":{"duration":8.692815,"end_time":"2024-04-23T07:28:37.115209","exception":false,"start_time":"2024-04-23T07:28:28.422394","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can build a tent if I have only a blanket and a rope??\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Step 1:** Gather your materials. You will need:\n","\n","- A blanket\n","- A rope\n","\n","**Step 2:** Find a suitable spot to set up your tent. Make sure the spot is level and free from obstacles.\n","\n","**Step 3:** Lay the blanket down on the ground. Make sure the edges of the blanket are pulled up and taut.\n","\n","**Step 4:** Tie the rope to the two corners of the blanket. Make sure the rope is long enough to tie a knot in the center.\n","\n","**Step 5:** Cross the rope over the center of the blanket. Make sure the rope is taut.\n","\n","**Step 6:** Pull the two corners of the blanket up and over the rope. Make sure the corners are taut.\n","\n","**Step 7:** Tighten the knot by pulling on the rope.\n","\n","**Step 8:** Stand up and adjust the tent as needed. Make sure the tent is stable and secure."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"build a tent if I have only a blanket and a rope?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"code","execution_count":34,"id":"95cc841b","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:37.165115Z","iopub.status.busy":"2024-04-23T07:28:37.164768Z","iopub.status.idle":"2024-04-23T07:28:46.390775Z","shell.execute_reply":"2024-04-23T07:28:46.389591Z"},"papermill":{"duration":9.253351,"end_time":"2024-04-23T07:28:46.393152","exception":false,"start_time":"2024-04-23T07:28:37.139801","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can scrap a dinner for my two kids with only 4 eggs, a pint of flour and some oil??\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Step 1:** Gather your materials.\n","\n","* 4 eggs\n","* 1 pint of flour\n","* 1 tablespoon of oil\n","\n","**Step 2:** Prepare the dough.\n","\n","* Divide the eggs into 4 equal parts.\n","* Add 1 tablespoon of oil to each part.\n","* Mix the eggs together until they are well combined.\n","\n","**Step 3:** Roll out the dough.\n","\n","* Divide the dough into 4 equal pieces.\n","* Roll out each piece of dough to a thickness of 1/4 inch.\n","\n","**Step 4:** Assemble the dinner.\n","\n","* Lay the 4 pieces of dough on a baking sheet.\n","* Top each piece of dough with 1/2 cup of flour.\n","* Add a tablespoon of oil to each piece of dough.\n","* Bake the dinner for 10-15 minutes, or until it is golden brown and cooked through.\n","\n","**Step 5:** Serve the dinner.\n","\n","* Serve the dinner with your kids."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"scrap a dinner for my two kids with only 4 eggs, a pint of flour and some oil?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"code","execution_count":35,"id":"9b3b364b","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:28:46.441415Z","iopub.status.busy":"2024-04-23T07:28:46.441122Z","iopub.status.idle":"2024-04-23T07:29:05.101531Z","shell.execute_reply":"2024-04-23T07:29:05.100594Z"},"papermill":{"duration":18.685968,"end_time":"2024-04-23T07:29:05.103828","exception":false,"start_time":"2024-04-23T07:28:46.41786","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions about how to do \n","various activities by yourself (do it yourself).\n","Return the answer formated nicely, for example step by step.\n","\n","\n","**<font color='red'>Question:</font>** How I can build a Swedish kindle in the woods??\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Step 1: Gather your materials.**\n","\n","- Wood (any type of wood will work)\n","- Nails or screws\n","- A pencil or screwdriver\n","- A piece of string or rope\n","- A magnifying glass\n","\n","**Step 2: Cut the wood to the desired size.**\n","\n","- Cut the wood to the desired size of the kindle. The size will depend on the type of project you're building. For example, a small project might require a piece of wood that's 12 inches long, 6 inches wide, and 2 inches thick.\n","\n","**Step 3: Assemble the frame.**\n","\n","- Lay out the wood pieces on a flat surface.\n","- Starting with the two long pieces of wood, attach them together using nails or screws.\n","- Make sure the joints are tight and secure.\n","- Repeat this step with the two short pieces of wood.\n","\n","**Step 4: Attach the frame to a tree.**\n","\n","- Find a sturdy tree that's the right size for the frame.\n","- Attach the frame to the tree using nails or screws.\n","- Make sure the frame is securely attached to the tree.\n","\n","**Step 5: Attach the string or rope to the frame.**\n","\n","- Cut a piece of string or rope that's long enough to wrap around the frame.\n","- Attach the string or rope to the frame using a knot.\n","- Make sure the knot is secure.\n","\n","**Step 6: Add the fire starter.**\n","\n","- Fill the frame with tinder or kindling.\n","- Secure the tinder or kindling in the frame using a piece of string or rope.\n","- Make sure the tinder or kindling is secure.\n","\n","**Step 7: Add the candle.**\n","\n","- Fill the frame with a candle.\n","- Secure the candle in the frame using a piece of string or rope.\n","- Make sure the candle is secure.\n","\n","**Step 8: Test the kindle.**\n","\n","- Light the candle and test the kindle to make sure it's working properly.\n","- Adjust the string or rope as needed to keep the kindle lit."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    action=\"build a Swedish kindle in the woods?\",\n","    ), \n","    max_length=512)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"markdown","id":"14816b88","metadata":{"papermill":{"duration":0.022384,"end_time":"2024-04-23T07:29:05.150769","exception":false,"start_time":"2024-04-23T07:29:05.128385","status":"completed"},"tags":[]},"source":["# Multiple steps reasoning (task chain)"]},{"cell_type":"code","execution_count":36,"id":"7a1295b0","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:29:05.198703Z","iopub.status.busy":"2024-04-23T07:29:05.198394Z","iopub.status.idle":"2024-04-23T07:29:07.025461Z","shell.execute_reply":"2024-04-23T07:29:07.024462Z"},"papermill":{"duration":1.853212,"end_time":"2024-04-23T07:29:07.027875","exception":false,"start_time":"2024-04-23T07:29:05.174663","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best city from France for tourists?\n","Question two: What are the best 3 of attractions from the city identified as answer to question one?\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Question 2:**\n","\n","The best 3 attractions from Paris, France for tourists are:\n","\n","1. Eiffel Tower\n","2. Louvre Museum\n","3. Palace of Versailles"],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best city from {country} for tourists?\n","Question two: What are the best {number} of attractions from the city identified as answer to question one?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    number=\"3\",\n","    country=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"code","execution_count":37,"id":"be148d80","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:29:07.078838Z","iopub.status.busy":"2024-04-23T07:29:07.078518Z","iopub.status.idle":"2024-04-23T07:29:10.356203Z","shell.execute_reply":"2024-04-23T07:29:10.355206Z"},"papermill":{"duration":3.305023,"end_time":"2024-04-23T07:29:10.358717","exception":false,"start_time":"2024-04-23T07:29:07.053694","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best food item from France?\n","Question two: What are the most important 3 ingredients for the food identified at first step?\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Question two:**\n","\n","The best food item from France is the **Croque Monsieur**, a sandwich consisting of a slice of bread filled with a savory filling of ground beef, cheese, and ham. The most important 3 ingredients for this dish are:\n","\n","1. **Bread**\n","2. **Ground beef**\n","3. **Cheese**"],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best food item from {country}?\n","Question two: What are the most important {number} ingredients for the food identified at first step?\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(\n","    number=\"3\",\n","    country=\"France\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"code","execution_count":38,"id":"0aa268e7","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:29:10.408909Z","iopub.status.busy":"2024-04-23T07:29:10.408213Z","iopub.status.idle":"2024-04-23T07:29:15.715607Z","shell.execute_reply":"2024-04-23T07:29:15.714523Z"},"papermill":{"duration":5.335306,"end_time":"2024-04-23T07:29:15.718592","exception":false,"start_time":"2024-04-23T07:29:10.383286","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are an AI assistant designed to answer questions in a chain of thought.\n","Use the answer to the first question as input for the second question.\n","Question one: What are the best food item from Italy?\n","Question two: What are the most important 4 ingredients for the food identified at first step?\n","\n","\n","**<font color='green'>Answer:</font>**\n","**Question 1: What are the best food items from Italy?**\n","\n","Italian cuisine is renowned for its exquisite flavors and rich culinary traditions. Some of the most popular and beloved food items from Italy include:\n","\n","- Pasta alla Carbonara\n","- Pizza Margherita\n","- Risotto al Milanese\n","- Tiramisu\n","- Gelato\n","\n","**Question 2: What are the most important 4 ingredients for the food identified at first step?**\n","\n","The most important 4 ingredients for the food identified at first step are:\n","\n","- Pasta\n","- Eggs\n","- Cheese\n","- Tomato sauce"],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["t = time()\n","response = gemma_lm.generate(prompt.format(\n","    number=\"4\",\n","    country=\"Italy\"\n","    ), \n","    max_length=256)\n","display(Markdown(colorize_text(response)))"]},{"cell_type":"markdown","id":"180ced65","metadata":{"papermill":{"duration":0.024622,"end_time":"2024-04-23T07:29:15.772917","exception":false,"start_time":"2024-04-23T07:29:15.748295","status":"completed"},"tags":[]},"source":["# Reasoning like Einstein will do "]},{"cell_type":"code","execution_count":39,"id":"fdb755c7","metadata":{"execution":{"iopub.execute_input":"2024-04-23T07:29:15.822835Z","iopub.status.busy":"2024-04-23T07:29:15.822295Z","iopub.status.idle":"2024-04-23T07:29:26.363757Z","shell.execute_reply":"2024-04-23T07:29:26.362784Z"},"papermill":{"duration":10.568933,"end_time":"2024-04-23T07:29:26.365983","exception":false,"start_time":"2024-04-23T07:29:15.79705","status":"completed"},"tags":[]},"outputs":[{"data":{"text/markdown":["\n","You are a math professor, smart but cool.\n","Background: A train traveling from Bucharest to Ploiesti (60 km distance) has the speed of 60 km/h. \n","The train starts in Bucharest and travels until Ploiesti, once, only in this direction.\n","A swallow, flying with 90 km/h, fly from Ploiesti to the moving train.\n","When it reaches the train, the swallow flies back toward Ploiesti,\n","ahead of the train. At Ploiesti turns again back and continues to fly back and forth \n","(between the train approaching Ploiesti and Ploiesti) until the train reaches Ploiesti. \n","The swallow will fly continously all the time the train is traveling from Bucharest to Ploiesti.\n","\n","\n","**<font color='blue'>Reasoning:</font>** Think step by step. Explain your reasoning.\n","\n","\n","**<font color='red'>Question:</font>** How many kilometers will travel totally the swallow?\n","\n","\n","**<font color='green'>Answer:</font>**\n","The swallow will travel a total distance of 120 km. \n","\n","**Explanation:**\n","\n","1. The swallow flies from Ploiesti to the train at 90 km/h. Since the train travels at 60 km/h, the swallow will be flying relative to the train for a total of 60 minutes (1 hour) while traveling from Ploiesti to the train. \n","2. After 60 minutes, the swallow turns back and flies back to Ploiesti. \n","3. When the train reaches Ploiesti again, the swallow flies back to the train at 90 km/h. \n","4. Since the train is already moving, the swallow will continue to fly back and forth between the train and Ploiesti as long as the train is traveling. \n","5. The total distance the swallow will travel is the sum of the distances it travels from Ploiesti to the train and from the train to Ploiesti. \n","6. Therefore, the total distance the swallow will travel is 60 minutes x 90 km/h + 60 minutes x 90 km/h = 120 km.\n","\n","\n","\n","**<font color='magenta'>Total time:</font>** 10.53 sec."],"text/plain":["<IPython.core.display.Markdown object>"]},"metadata":{},"output_type":"display_data"}],"source":["prompt = \"\"\"\n","You are a math professor, smart but cool.\n","Background: A train traveling from Bucharest to Ploiesti (60 km distance) has the speed of 60 km/h. \n","The train starts in Bucharest and travels until Ploiesti, once, only in this direction.\n","A swallow, flying with 90 km/h, fly from Ploiesti to the moving train.\n","When it reaches the train, the swallow flies back toward Ploiesti,\n","ahead of the train. At Ploiesti turns again back and continues to fly back and forth \n","(between the train approaching Ploiesti and Ploiesti) until the train reaches Ploiesti. \n","The swallow will fly continously all the time the train is traveling from Bucharest to Ploiesti.\n","Reasoning: Think step by step. Explain your reasoning.\n","Question: {question}\n","Answer:\n","\"\"\"\n","t = time()\n","response = gemma_lm.generate(prompt.format(question=\"How many kilometers will travel totally the swallow?\"), \n","    max_length=512)\n","display(Markdown(colorize_text(f\"{response}\\n\\nTotal time: {round(time()-t, 2)} sec.\")))"]},{"cell_type":"markdown","id":"f354947b","metadata":{"papermill":{"duration":0.024645,"end_time":"2024-04-23T07:29:26.41615","exception":false,"start_time":"2024-04-23T07:29:26.391505","status":"completed"},"tags":[]},"source":["# Conclusions\n","\n","\n","## Using gemma_2b_en\n","\n","Initially, I used the model `gemma_2b_en` and I was not really happy with the results. The main problems I found were:\n","* The model will answer incorectly to the question\n","* The model will answer to more question than the one answered\n","* The model will stop suddently in the middle of a phrase\n","\n","## Using gemma_instruct_2b_en\n","\n","Then, I got a good advice in the comments from one of the Kagglers (thank you @paultimothymooney) and switched to `gemma_instruct_2b_en` with much better results.\n","\n","Here is the analysis of results with `gemma_instruct_2b_en`:\n","* General question: answer to the point, and the answer seems sensible. Well, it is actually not entirely correct, but it is close. And the question did not clarify if it is during solar exposure or in the shadow. \n","* It is clear that the model doesn't know history. European history questions were missed totally. American history (very simple questions) were aced, though.\n","* Math problem, with answer as Python code: correct, and code is documented.\n","* More Python code: if too complex, start to make mistakes.\n","* Software design questions: was able to define correctly a phone agenda class and an REST API service (using Flask)\n","* C++ and Java code of decent quality, Missed though the volume of cylinder (formula is not correct)\n","* Multi-parameters question: all answers are correct. \n","* A chain of reasoning (one task receives as input the output of the previous task) was performed correctly.\n","* More difficult math problem, requiring reasoning: the answer is not correct, because the reasoning is not correct but, to be fair, ... the problem contains a paradox. Did you (intelligent human reading this) notice what is the paradox?\n","\n","\n","We were also evaluating the time for the response of various queries, with different `max_length` parameter. From less than one sec., for `max_length` = 256, it can raise to 1/2 min or more, for `max_length` 512 or 1024."]}],"metadata":{"kaggle":{"accelerator":"nvidiaTeslaT4","dataSources":[{"databundleVersionId":7669720,"sourceId":64148,"sourceType":"competition"},{"modelInstanceId":5171,"sourceId":11371,"sourceType":"modelInstanceVersion"},{"modelInstanceId":5388,"sourceId":11372,"sourceType":"modelInstanceVersion"}],"dockerImageVersionId":30673,"isGpuEnabled":true,"isInternetEnabled":true,"language":"python","sourceType":"notebook"},"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.10.13"},"papermill":{"default_parameters":{},"duration":408.592132,"end_time":"2024-04-23T07:29:29.831104","environment_variables":{},"exception":null,"input_path":"__notebook__.ipynb","output_path":"__notebook__.ipynb","parameters":{},"start_time":"2024-04-23T07:22:41.238972","version":"2.5.0"}},"nbformat":4,"nbformat_minor":5}