How to Use Foyle AI with Runme

This guide shows you how to use Runme Notebook to run and execute commands and prompts. By integrating Foyle, an AI assistant, you can execute cells containing shell commands or Markdown. However, to perform these actions, Foyle works within the Runme Notebook to enable you to input prompts and display the generated output directly within the Notebook.

This makes it easy to add and run commands, as Foyle can automatically create and execute the necessary cells based on your input. With Runme's interactive notebook, you can perform these operations and view your completed tasks.

Installation

To get started, ensure you have the following installed:

• Runme Extension

To access the Runme Notebook, install the Runme extension in your VS Code editor. You can also set Runme as your default Markdown viewer.

• Install Foyle

To install Foyle, follow the steps as instructed here.

Setting Up Foyle with Runme

After successfully installing Foyle, the next step is to set it up. This section will break down the setup process.

1. Configure Your OpenAPI Key

To kickstart setting up Foyle on your local machine, you will need to configure your OpenAPI key. This will give you access to work with Foyle. Go to OpenAI to obtain your unique API key.

Once you have gotten your key, save it in a plain text file and run the command below.

foyle config set openai.apiKeyFile=/path/to/openai/apikey

2. Start the Server

Run the command below to start the Foyle server on your local machine. However, you must ensure your API Key is in the directory where this command will run. If it isn’t, you can set the directory of your code cell to the directory where your API Key is located using the CWD feature of Runme.

foyle serve

This command should start Foyle in the background. To make it run without disrupting your activities, activate your cell's background task mode. This feature will make Foyle run as a background task without interrupting your progress.

Once that is done, run the cell, and you will get an output similar to the image below.

By default, Foyle uses port 8080 for the HTTP server and port 9080 for gRPC. You can configure this by running the command below if you would love to use different ports.

export FOYLE_HTTP_PORT=YOUR HTTP PORT
export FOYLE_GRCP_PORT=YOUR GRPC PORT
foyle config set server.httpPort=$FOYLE_HTTP_PORT
foyle config set server.grpcPort=$FOYLE_GRPC_PORT

3. Confirm Foyle's Address

If you would love to confirm your Foyle Address in VS Code, do the following.

• Open the VS Code setting palette
• Search for Runme: Foyle Address
• Set the address to localhost:${GRPC_PORT}. By default, the port is 9080. If you set a non-default value, it will be the value of server.grpcPort

Running Foyle Operations with Runme

Now that Foyle has been successfully installed and set up in your Runme Notebook, we can proceed to test it out by performing some operations, such as asking it questions like we would ask an AI tool.

In this section, we will be performing several operations with Foyle, such as setting up a kind cluster, getting a list of all namespaces in a cluster, and listing and describing pods.

Running a Prompt

With this integration, you can ask a question using Foyle within the Notebook to generate a response. Remember, Foyle allows you to add cells and execute commands within a Notebook.

In the example below, we will demonstrate “How to set up a kind cluster” using Foyle in our Runme Interactive Notebook.

To do this, first, create a new Markdown cell in your Markdown file and type your questions. For instance, in the video below, we will ask Foyle, "How do I set up a kind cluster?"

Foyle will answer the question below.

Executing a Command

When you enter a command in the Notebook, you can run it to get a response. Foyle processes the command and displays the response in the Notebook.

To run the question and get Foyle to answer, press shift + command + p. This will open a dashboard with several options. Select Generate cells using the Foyle assistant.

In the video below, we prompt Foyle to list all pods. Foyle returns the command, which you can run in the Markdown file to get the list of all pods.

Generate Output Based on Previous Command

Additionally, you can also use Foyle to generate output based on your previous commands. Foyle will follow the events from your previous commands or output and return the result in the Notebook.

In the image below, we are asking Foyle to describe a pod from the list of pods we got in the example above.

Learning with Foyle

This section will show you how to configure Foyle to learn from your interaction to get improved outputs.

Configure Foyle to use RAG.

The first step is to configure Foyle to use RAG. To do this, run the command below

foyle config set agent.rag.enabled=true
foyle config set agent.rag.maxResults=3

Enabling Logging In RunMe

The next step is to enable logging in Runme. Using Runme as the frontend for Foyle will require you to configure Runme to enable the AI logging experiment. To do that, perform the steps below.

1. In your VS Code, open the settings panel
2. Search for Runme › Experiments: Enable Ai Logs in the search bar.

Enabling this feature makes logging server logs used for training AIs possible.

Now that logging is enabled, you can verify that logs are being written and identify their location, as shown in the image below.

To view the logs, you need to follow the steps below;

• Create a new code cell block using Runme's CWD feature and configure the path for that code cell block to the log file path shown earlier.
• Run the command ls -la to access the file's content, as shown below.

• Now that you see the content and the logs, you will want to view the current log. To do that, run the command below in your Markdown file after setting your directory path, as you did in the step above.

code logs.2024-07-24T10:50:24.json

The field aiLogs will contain the file that the current instance of Runme uses for the JSON logs.

By default, Runme will use the directory on MacOS.

Configuring Learning

To configure Foyle with the location of Runme’s logs directory, run the command below

export RUNME_LOGS_DIR="/Users/${USER}/Library/Application Support/runme/logs/"
foyle config set learner.logDirs=${RUNME_LOGS_DIR}

This will use the Runme Environment Prompt Variable to prompt you to confirm your RUNME_LOGS_DIR path and output, as in the image below.

Feedback and Contribution

If you have any tool or project you would like to see integrated with Runme, feel free to contact us with your idea. We will be glad to test it out.