🤖How to build an AI Copilot?

Build your no-code AI copilot in minutes!

What is an AI Copilot?

An AI Copilot is a conversational chatbot that harnesses the abilities of modern AI models to summarize, make decisions and perform step-by-step analysis. With Gooey, it can be enhanced with custom knowledge documents, photo and document recognition, internet look-ups, speech recognition, integrations with WhatsApp, Facebook or your API to create incredible versatile tools.

Why do we need AI Copilot?

In practice, AI copilots and chatbots are generally useful at three broad functions: Increasing productivity (e.g. saving time), unlocking knowledge and helping users conversationally accomplish a task (e.g. TurboTax for Anything).

Our approach with Gooey.AI is that we learn best when we can see work of others and hence, please check out https://gooey.ai/copilot/examples.

Agriculture: Farmer.CHAT

Trades: HVAC Master Technician

Health: Nurse advisor for Nigeria

Barebones GPT-4o + (Google Search) Copilot

What we offer

Gooey.AI's Copilot is the most advanced chatbot builder in the industry because we make all of the latest AI models available to you in no-code, team workspace and allow you to quickly deploy and measure what’s actually useful so you can reach product-market fit faster.

We offer:

• One-click Integrations to the most common everyday communication

  • Whatsapp - including support for multi-lingual, voice notes, photos, buttons, location sharing, RAG citations + function calling.

  • Custom one-click web widget - deploy in seconds to the web or inside your site or app.

  • Facebook

  • Slack

  • Publish your bot as API

  • SMS + IVR for non-smartphone AI copilots (Enterprise only)

• LLM Agnostic:

  • Selection of multiple Large Language Models (OpenAI GPT4o, o1, o3 reasoning models, DeepSeek, Mistral, Meta's LLaMa 3.3, Gemini 2,Claude 3.5 and smaller local fine-tuned models like Sarvam 2B, SEA-Lion, and AfroLLAMA.)

• Language and regional accent support:

  • Speech Recognition & Translation to understand incoming audio messages, powered by the latest models from Azure, Google, Meta, OpenAI, and Bhashini.

  • Language translations (including Google Translate, Bhashini, Seamless)

  • Text-to-speech for the widest range of global accents and cloned voices from Google,OpenAI, Azure, and EvelenLabs (so the bot can send back audio responses)

• Function calling:

  • Function calling enables tool support and agentic decision-making, meaning the AI model can decide whether and when the function must be executed and/or if code should be written to fulfill a request.

  • Function calling for OpenAI, Mistral and LLaMa models allows your copilot to securely read and write to your company data, perform google searches and even write and execute code in real-time.

  • Every function call are themselves workflows of Javascript code, meaning you can collaborate on them like any other Gooey Workflow.

  • Function calling is supported by Azure back secret support so you can safely call private APIs (and no one outside your team - including Gooey staff - will have access to your secret API keys)

• Audio and Video Generation:

  • This empowers more users to engage with the app with voice and video notes - no typing required!

  • Lipsync’d video generation with LipSync with Text-to-Speech. Copilots with avatars can create higher engagement and trust.

• Document and Vision Intelligence:

  • Our copilots (and their integrations with WhatsApp, the web, slack, etc) natively support audio, images and documents as inputs, allowing scenarios such as using a nameplate to recognize a part number, recognizing plant ailments from photos and extracting data from ID documents to aid out filling out forms.

• Retrieval Augmented Generation + vectorDB:

  • Retrieval Augmented Generation (with a Google doc, PDF, or Excel and even Weblinks) + advanced features including:

    • Dense Embeddings

    • Keyword Search Extraction - useful for highly technical knowledge bases with lots of jargon

    • Conversation summarization - to create better vector DB queries

• Synthetic Data Extraction (with page-level citations)

  • Often the knowledge base material of a copilot is less than ideal. PDFs are often blurry, complex, and filled with irregular charts and tables. Videos contain useful insights but long rambling transcripts.

  • Our synthetic data tools give you an easy-to-use but customizable pipeline to prepare PDFs, audio, videos, PPTs, etc for inclusion into copilots. We support all the best OCR and AI vision tools to understand PPTs and PDFs and then give you power of LLM prompts to create structured data from highly unstructed sources.

  • For example, you can transform both PDFs and videos into editable Google sheets, with all the text/transcript extracted and translated, with an automatic FAQ for each page, with citations given to the particular page number. We’ve found this dramatically improves search results.

• Analysis tools:

  • Built-in feedback buttons

  • Detailed Copilot Dashboard Insights

  • Configurable Conversation Analysis

  • Integrate with your own analysis tools: Push copilot data to external sources in real-time (via POST functions) or on a schedule.

• Bulk Evaluation: specify a set of test questions and golden answers, and then the tool automatically compares and scores competing versions of your bot.

How it works?

Gooey.AI's Copilot uses the latest orchestration capabilities for Large Language Models. The general ability of LLMs is to summarize, analyze, and make decisions but it is NOT trained on your enterprise data. To overcome this, we are moving with an innovative and simple solution called Retrieval Augmented Generation.

What is Retrieval Augmented Generation?

Retrieval Augmented Generation (RAG) allows users to search indexed Domain Specific Information to ensure that LLMs provide the most accurate and up-to-date information about your enterprise needs.

Your data is prepared and indexed and when the user queries the AI Copilot searches and filters your data to the most relevant snippets. With the snippets and the system prompt, the LLM analyzes and summarizes an appropriate response to the user query. This flow of information ensures that the AI Copilot:

1. Remains accurate and up-to-date

2. It avoids hallucinating for a response

3. It does not respond to queries beyond the scope of your Knowledge Base (unless you want it to).

4. Mitigates risk to the organization

5. Builds users' trust by providing relevant information

How does RAG LLM work?

REAL-WORLD OVERVIEW OF COPILOT VIA FARMER.CHAT

How to build your copilot:

Gooey.ai offers a simple no-code UI to build RAG-based copilots in seconds. The interface is fairly intuitive and we encourage to you play with our examples and simply modify them.

If you would still like a step-by-step guide, please read through the sub-sections of this guide.

This is the basic setup:

1. Relevant documents from your organization

2. A prompt script for the AI bot to follow

3. Hit Submit!

Try Farmer.CHAT

An AI assistant to help farmers and farmer agents.

Try Bank.CHAT

An example AI assistant to improve bank literacy.

Copilot Guide Step 1: BEFORE you build a Bot