MarketplaceCommunityDEENDEENProductsCore ServicesRoadmapRelease NotesService descriptionCertifications and attestationsPrivate CloudManaged ServicesBenefitsSecurity/DSGVOSustainabilityOpenStackMarket leaderPricesPricing modelsComputing & ContainersStorageNetworkDatabase & AnalysisSecurityManagement & ApplicationsPrice calculatorSolutionsIndustriesHealthcarePublic SectorScience and researchAutomotiveMedia and broadcastingRetailUse CasesArtificial intelligenceHigh Performance ComputingBig data and analyticsInternet of ThingsDisaster RecoveryData StorageTurnkey solutionsTelekom cloud solutionsPartner cloud solutionsSwiss Open Telekom CloudReferencesPartnerCIRCLE PartnerTECH PartnerBecome a partnerAcademyTraining & certificationsEssentials trainingFundamentals training coursePractitioner online self-trainingArchitect training courseCertificationsCommunityCommunity blogsCommunity eventsLibraryStudies and whitepaperWebinarsBusiness NavigatorMarketplaceSupportSupport from expertsAI chatbotShared ResponsibilityGuidelines for Security Testing (Penetration Tests)Mobile AppHelp toolsFirst stepsTutorialStatus DashboardFAQTechnical documentationNewsBlogFairs & eventsTrade pressPress inquiriesMarketplaceCommunity

0800 3304477 24 hours a day, seven days a week

Write an E-mail 

Book now and claim starting credit of EUR 250
ProductsCore ServicesPrivate CloudManaged ServicesBenefitsPricesPricing modelsPrice calculatorSolutionsIndustriesUse CasesTurnkey solutionsSwiss Open Telekom CloudReferencesPartnerCIRCLE PartnerTECH PartnerBecome a partnerAcademyTraining & certificationsCommunityLibraryBusiness NavigatorMarketplaceSupportSupport from expertsHelp toolsTechnical documentationNewsBlogFairs & eventsTrade pressPress inquiries
  • 0800 330447724 hours a day, seven days a week
  • Write an E-mail 
Book now and claim starting credit of EUR 250

How to: AI chatbot in seven weeks

by Editorial team
Illustration of the Open Telekom Cloud Chatbot
 

In this article you can read

  • how the AI chatbot of the Open Telekom Cloud came about,
  • what added value it creates for cloud users,
  • and what role Retrieval Augmented Generation (RAG) played in this.

What is the potential of artificial intelligence? The Open Telekom Cloud – as a user – has dared to try. Our website has been offering the first LLM-based, freely available AI chatbot from a cloud provider as of July 2024. We combine the strengths of artificial intelligence and Retrieval Augmented Generation (RAG). The chatbot was developed in just seven weeks together with our partner amberSearch.

How can companies quickly get an AI application?

Everyone is talking about artificial intelligence and many companies want to answer two questions in particular:

  • Where are AI use cases that will bring us tangible added value?
  • How can we implement AI use cases easily, quickly and cost-effectively?

“As the Open Telekom Cloud, we have various points of contact with artificial intelligence,” says Norbert Brüll, the project manager for the ChatBot frontend, ”As an AI provider, we are pursuing various AI initiatives with our partners.” These include the provision of development and training environments (e.g., via ModelArts), data pipelines, the GDPR-compliant operation of AI services and the offer of an LLM Hub.

Open Telekom Cloud as an AI user: the challenge

“With the current project, we have changed our perspective and put ourselves in the shoes of an AI user. We wanted to explore the possibilities of AI for ourselves and our customers,” says Brüll. The use case was quickly found - the Open Telekom Cloud also has a typical enterprise problem: a lot of data is “scattered” in many different places. Users (both internal and external) often have to search until they find the right information. The solution – in times of AI – lies in an intelligent search assistant that taps into all sources and summarizes the information in a handy answer. 

 
Norbert Brüll, Senior Service Manager der Open Telekom Cloud
 

The solution – in times of AI – lies in an intelligent search assistant that taps into all sources and summarizes the information in a handy answer.

– Norbert Brüll, Senior Service Manager and Project Manager Chatbot Frontend of the Open Telekom Cloud

Intelligent knowledge management with AI as a solution

“An enterprise search or intelligent knowledge management reduces search efforts in such cases by an average of 40 percent,” explains Bastian Maiworm, founder and CEO of amberSearch, ”The productivity gains are obvious.”

In May 2024, amberSearch and the Open Telekom Cloud launched the project to get the new AI-based chatbot up and running. The basis for this were services that the start-up had already developed, which are now available quickly and easily as a standard product. These include the semantic search “amberSearch” and the question-answer system “amberAI”, which are based on a self-developed and trained Large Language Model (LLM). In the basic version, the amberSearch services function as a kind of ChatGPT that can be used to chat about any topic.

“But that wasn't the intention of our Open Telekom Cloud Chatbot,” says the project manager, ‘it was designed to help our users find relevant information and use it for simple cloud applications, in line with the motto ’Find it fast'.” The aim was to quickly answer questions such as “How do I deploy a Kubernetes cluster?” or “What functionalities does the backup service offer?”.

 
Bastian Maiworm, Co-Founder von amberSearch
 

With the AI chatbot for the Open Telekom Cloud, we have demonstrated how easy it is to build a value-added AI service for knowledge management. Virtually any company can benefit from such a blueprint.

– Bastian Maiworm, co-founder of amberSearch

Available amberSearch modules plus Open Telecom Cloud info via RAG

To do this, the existing amberSearch system needed access to the relevant sources. Specifically, these are the Open Telekom Cloud website, the document library (Doc Library), community content and a collection of PDFs such as the service description. “To give the chatbot access to this information, we used a technology known as Retrieval Augmented Generation (RAG),” explains Maiworm. When using RAG, an AI model is not retrained or fine-tuned – which also eliminates the corresponding effort and costs. Instead, the chatbot cooperates with an enterprise search. When a question is asked, a search is first triggered in the connected sources. The information is made available to the AI model depending on the situation and then condensed into an answer. It thus remains within the company or in the repositories where it is stored anyway. amberSearch offers various methods to make the data accessible to the bot. Specifically, an API is used for the multimedia content of the community (videos etc.), while the other sources are searched several times a day using a crawler. The information is collected and standardized in a vector database. This database then acts as a consolidated basis for the concentrated Open Telekom Cloud knowledge from which the bot draws. The automated updates of the vector database ensure that the bot's knowledge stays up to date on a daily basis.

AI Chatbot Illustration

AI chatbot in seven weeks

The chatbot was created in just seven weeks and has been running since mid-July. It provides users of the Open Telekom Cloud with easy access to the latest knowledge they need; tedious searches are a thing of the past. The bot also documents the sources from which it has obtained the relevant information – this reduces the likelihood of hallucinations. “Our chatbot is easily accessible via the support tab on the right-hand side of the screen (AI). No registration is necessary,” says Brüll. “By operating the vector DB and the model within the Open Telekom Cloud, the team has full control over the AI. This also includes GDPR compliance,” adds Maiworm, ”so that a second stage can also be implemented if necessary, in which personal data is processed via a login.”

So – approach the bot and ask it what you always wanted to know about the Open Telekom Cloud. Incidentally, the bot is not just an information assistant, but can also help you in a very practical way. Norbert Brüll: “If you want to deploy a service, you don't have to wade through API documentation or community input, you can simply ask the bot for a deployment setup on a container basis – including code”.


This content might also interest you
 

Display of networked light points

Artificial intelligence (AI)

The cloud offers needs-oriented access to computing resources that meet these requirements – whether CPUs, GPUs or bare metal servers.

 
The Open Telekom Cloud offers suitable options for artificial intelligence.

A flying start into artificial intelligence

The cloud offers various options for quickly implementing services with artificial intelligence (AI) – individually tailored to company requirements and strategy.

 
Abstract pair of hands holding a green plant shoot in a pot.

Trusted AI: You reap what you sow 

From healthcare to lending, artificial intelligence is making more and more decisions in everyday life - some with enormous implications. 

 

The Open Telekom Cloud Community

This is where users, developers and product owners meet to help each other, share knowledge and discuss.

Discover now

Free expert hotline

Our certified cloud experts provide you with personal service free of charge.

 0800 3304477 (from Germany)

 +800 33044770 (from abroad)

 24 hours a day, seven days a week

Write an E-Mail

Our customer service is available free of charge via E-Mail

Write an E-Mail

AIssistant Cloudia

Our AI-powered search helps with your cloud needs.