ServiceNow Components

Server Side Script Include

The purpose of this, is to allow for easy calls to the API server via the midserver.

Client Callable Script Include

This allows the front end to access that large language model server (llm) and a vector database (vectordb).

UI Action

This is one of two ways to mainly make that client call to the server. It’s a button that you can put on a form on both Core UI and Workspaces. This leverages a UI Page which is what actually makes the summarize call.

Scheduled Job

This makes a call to push data into the vector database. It’s how you control what data en masse is available to the llm.

Onload client script

The onload client script looks in the vector database for the data and if present, it will show it.

Properties

ai.in.a.box.midserver

The midserver name to use for all calls

ai.in.a.box.model

The model to use for all calls, default available is the tinydolphin:latest and mistral:7b-instruct

ai.in.a.box.endpoint

The url to the API server relative to the midserver. Because they are on the same docker compose network, the midserver can access the API server via the service name.

ai.in.a.box.credential

This is the sys_id of the credential(sys_auth_profile_basic) to authenticate to the AI In A Box server.

This is used in the script include to make rest messages using RESTMessageV2 and setAuthenticationProfile