Logo showing the interaction of human and AI to produce an idea.

Making your own Chatbot

How easy is it to make your own chatbot using a pre-determined set of training resources?

The answer probably ranges from very easily and cheaply to, with some effort and at great cost of manhours and subscriptions.

Larry Ferlazzo created five using ChatGPT. When I asked him how, this was his response:

It was easy with ChatGPT. You can create your own custom chatbot. I just told each one to use the list of resources and experts I gave it as its knowledge base, and nothing else. I had to repeat those instructions a few times, but they seem to work fine.

An alternative, to provide support for a specific course, is to build from scratch as follows:

“The AI Companion will be based on a Retrieval-Augmented Generation (RAG) architecture, ensuring pedagogical grounding and minimisation of hallucinations. It will include the following elements:
A Learner Interface: Learners will interact through a simple chatbot window integrated into the e-learning platform. They will be able to:

  • Ask natural language questions
  • Interact with course modules
  • Request clarifications
  • Explore digital entrepreneurship-related topics
    The interface will be accessible, intuitive, and designed specifically for users of low digital-literacy (NEETs).
    An Entrepreneurial Knowledge Base: To ensure accuracy and alignment with course objectives, the AI Companion will rely on a curated and project-controlled knowledge base instead of unrestricted internet queries.”

I don’t yet know how different these two alternatives are in reality, especially in terms of quality of response and interaction. Asking Co-Pilot resulted in the following table:

FeatureGeneral GPTLarry’s ChatbotsRAG Companion
Knowledge sourceEntire modelEntire model + embedded resource listCurated external knowledge base
RetrievalNoneNoneYes (vector search)
Hallucination controlLowMediumHigh
UpdateabilityNoneManual prompt editsContinuous KB updates
Pedagogical alignmentNoneLightStrong
Integration with platformNoneNoneFull (modules, progress, scaffolding)
Accessibility for low‑literacy learnersNoneNoneDesigned for this
EU compliance (data control, transparency)WeakWeak–mediumStrong
Development costNoneVery lowMedium–high
Maintenance costNoneLowMedium
Suitability as a learning companionLowMediumHigh

There are intermediate possibilities between the Ferlazzo prompt model and the full RAG implentation so how do they stack up?

ApproachCostTechnical complexityHallucination controlPedagogical alignmentSuitable for NEET learners?
Ferlazzo-style promptVery lowVery lowLow–mediumLowNo
Chunked KB in promptLowLowMediumMediumMaybe
Lookup-table “toolformer”Low–mediumMediumMedium–highMedium–highYes, with UI work
Lightweight RAGMediumMediumHighHighYes
Full RAG Medium–highHighVery highVery highYes

So RAG, creating your own carefully curated trove of materials, is obviously a good idea but even here there are options for strength of implementation.