Transforming Edict Management with Artificial Intelligence
Sector: Information Services.
COMPANYCommercial and Reputational Risk Management: Leader in commercial and reputational risk management. Specializing in B2B services, the company helps corporations assess and mitigate risks associated with business counterparties such as customers, suppliers and contractors.
CHALLENGE: AUTOMATE OFFICIAL INFORMATION PROCESSING
Fidelitas faced a complex problem: analyzing and manually processing large volumes of information from Official Gazettes.
These documents, written in an ambiguous manner and without a standardized format, made it difficult to identify and efficiently load key data. For years, this process was performed manually, which implied a significant investment of time and resources, as well as a high probability of errors.
The advent of more accessible artificial intelligence (AI) models opened the door to a possible solution. As Felix El Idd (CEO of Fidelitas) mentioned, "When LLM AI models became accessible, we imagined that we could interpret those texts programmatically to extract the data on a massive scale (several tens of thousands of Edicts per year)."
It was in this context that Fidelitas decided to implement an AI-based solution, supported by Etixen, to automate edict interpretation and data extraction accurately and efficiently.
THE SOLUTION: ARDUOUS PROCESS OF TRAINING IA MODELS AS A KEY TO ORGANIZING AND EXTRACTING ACCURATE INFORMATION
The work process with Fidelitas was divided into two main stages:
As a first step, prompting, which in Felix's words "The Prompting stage was (and is) the most complex, since to this day the models are not totally stable."
This is why the Fidelitas and Etixen teams continue to work on optimizing prompts and training models to improve the accuracy of the results. It must be understood that this is an evolutionary process, where new technologies emerge regularly and need to be adapted to them.
The second stage is training:
To overcome the difficulties of stability in prompting, a training phase was implemented with different AI models. During this process, we experimented with GPT-3.5 and GPT-4, observing key differences in the quality of the results:
The arrival of GPT-4 represented a positive change, achieving a substantial improvement in data extraction.
With its implementation, better hit percentages began to be obtained, although at a high cost. We also tested GPT-4-mini, which offered better results than GPT-3.5, but without the desired stability. Currently, with the reduction of costs per token, it was decided to continue with GPT-4o models and we are already working with large volumes of data to further optimize the process.
Felix El Idd, comments: "We are now with results exceeding 95% success rate, and trying to ensure that those erroneous cases can be identified for special treatments and not be mixed with those that directly impact our database."
THE ROLE OF ETIXEN
The joint work between was key to the success of the key to the success of the projectallowing a progressive evolution of the solution. From the beginning, our team of developers led the research and training in AI, guiding Fidelitas in the optimization of its processes.
"It was a very good experience of growing as a team. We worked testing and learning together. All the initial research was carried out by Etixen and they trained us very well. It was very positive and I think we all learned a lot. Thanks to this, today we have a lot of experience in models, prompts, and training, both for OpenAI and other services."
RESULTS: IMPACT AND FUTURE VISION
The implementation of AI in Fidelitas' daily work radically transformed the way they process official edicts, significant impact on their business.. Among the main benefits achieved, the following stand out:
- Reduction of manual labor: The automation of the process made it possible to reduce the operational burden on the team.
- Accuracy in data extraction: Ensuring that the information processed is reliable.
"While we are still working on our side for model stabilization, Etixen allowed us to take all the initial steps and training needed to introduce our team to the world of AI. The impact was very positive."
When asked if they would recommend this solution to other companies that handle large volumes of information, the answer was clear:
"Of course I would recommend it. There are thousands of challenges still for our industry where efficiency levels can be strongly improved. Fidelitas handles various data, and AI has become an indispensable assistant to improve the present and rethink our future."
EVOLUTION
While the implementation was a success, together with the Fidelitas team we continue to work on improving the stability of the models and expanding their use to new areas.
"We are now training models for Press information search, and for Score calculations." Felix El Idd
In addition, significant improvements in the use of the models in the use of the models thanks to a combination of training and advanced prompting techniques. "The combination of prompting engineering improvements along with the trainings were key to being able to move forward."
Fidelitas' experience shows that artificial intelligence can not only automate repetitive tasks, but also enable companies to reinvent the way they manage information.
Thanks to the work of the developers, state-of-the-art AI models were integrated, improving efficiency and laying the groundwork for future innovations in all sectors that wish to implement this type of change.
Every digital transformation starts with a goal. Tell us yours and let's design together the ideal solution for your company. The next success story can be yours!
