Reading time • 5 min
Podcast | English

Using generative AI your organization the right way.

This article explores the challenges and opportunities of using generative AI in companies, highlights pioneering projects such as dMgPT, and provides an overview of existing AI systems, risks, and enterprise GenAI solutions.

Ever since the hype around generative AI began, companies have been grappling with how and where to apply this technology. Pioneering projects such as dmGPT  from dm have already provided an insight into the possibilities. However, it remains unclear which use cases are actually suitable, how they can be implemented effectively and how employees can be empowered. This article provides a clear overview of existing AI systems and the associated risks. The focus is on Enterprise GenAI solutions. Other interesting use cases can be found under Use Cases.

Ever since the hype around generative AI began, companies have been grappling with how and where to apply this technology. Pioneering projects such as dmGPT  from dm have already provided an insight into the possibilities. However, it remains unclear which use cases are actually suitable, how they can be implemented effectively and how employees can be empowered. This article provides a clear overview of existing AI systems and the associated risks. The focus is on Enterprise GenAI solutions. Other interesting use cases can be found under Use Cases.

What types of in-house enterprise GenAI applications exist for small and medium-sized companies?

3 types of ChatGPT application

Three types of in-house Enterprise GenAI applications can be distinguished

1. Online SaaS tool

This category includes third-party software solutions that are used without deep integration with internal systems. An example is ChatGPT Plus. Such tools are ideal for specific functions and individual users, offer a relatively low cost of entry and low maintenance costs, but have limited customisation capabilities.

2. Internal application

These are purpose-built applications for internal use only, such as an expert chat system. These applications allow complete control over internal data, effective user management and can be fully integrated with existing systems. They also offer extensive customisation options.

3. Customer-facing application

These applications are aimed at external users and play an important role in customer interaction, such as a self-help application. They contribute to the brand image, improve the user experience, offer value-added services to customers and must meet high standards in areas such as data protection (GDPR) and reliability.

What are the risks of introducing AI applications in SMEs?

adapted from source: https://boringappsec.substack.com/p/edition-21-a-framework-to-securely 

The use of generative AI models in organisations brings with it four risk factors that need to be carefully assessed to ensure that the use of these technologies is effective and compliant:

1. Data leaks:

Improper handling of data, particularly in customer-facing applications, can lead to the inadvertent disclosure of sensitive or proprietary information. This underlines the need for strict data cleansing and clear terms of use.

2. Denial of Service (DoS)

Attackers can overload LLMs with resource-intensive requests, resulting in a degradation of service quality or increased operational costs. Self-hosted LLMs are particularly vulnerable due to the infrastructure required.

3. Losing money

The use of third-party LLMs that charge by usage can lead to unexpectedly high costs without proper monitoring and validation. Attacks that artificially inflate usage volumes can also lead to financial losses.

4. Overreliance on LLMs

Over-reliance on LLM spend can lead to poor decisions and legal issues, especially if the models produce false or misleading information, a phenomenon known as 'hallucination'.

What is a Retrieval Augmented Generation (RAG) application?

Retrieval Augmented Generation (RAG) is a technique that improves the accuracy of generative AI models by integrating external information sources. RAG combines AI model generation processes, in particular Large Language Models (LLMs), with external databases or resources to retrieve relevant facts on current or specific topics.

This method reduces the risk of incorrect or irrelevant answers (‘hallucinations’). By adding verifiable data sources, the models can provide more accurate and reliable information, which increases reliability and improves the user experience.

How do I properly empower my employees?

In order to effectively empower employees to use generative AI, such as Retrieval Augmented Generation (RAG), the following measures should be implemented:

1. Provide risk awareness training

Targeted training on the specific risks of GenAI is essential. This should include practical examples to teach the correct use of the technologies, in particular to minimise the risk of misinformation.

2. Encourage innovation

Policies should allow employees to experiment with GenAI. It is important that management supports these efforts and recognises the importance of innovation for technological development and competitiveness. 

3. Encourage knowledge sharing

Regular workshops and webinars to share experiences and challenges are crucial. These formats support not only knowledge sharing, but also collective problem solving and innovation within the organisation.

These approaches will ensure that teams are well prepared to effectively address the challenges and opportunities of GenAI. Empowering teams will become even more important in light of the EU's AI Act, which will come into force in 2026, and Article 4 of which stipulates, among other things, that employees who come into contact with AI systems must be trained accordingly.

30 Min.

Would you like to know more about applications of generative AI in your company?

Do you have any questions or need more information on the possible applications of generative AI in your company? Do not hesitate to contact us.
Kostenlose Beratung buchen
Noah Baader from triebwerk.ai
Noah Bader
AI Innovation Lead
30 Min.

Would you like to know more about applications of generative AI in your company?

Do you have any questions or need more information on the possible applications of generative AI in your company? Do not hesitate to contact us.
Kostenlose Beratung buchen
Julian Speckmaier from triebwerk.ai
Julian Speckmaier
Head of business strategy

Weitere Artikel