USING ARTIFICIAL INTELLIGENCE TO TRAIN FUTURE PHARMACISTS : EVALUATION OF A CHATBOT DEVELOPED FOR THE ONCOLOGY PHARMACY UNIT
European Statement
Education and Research
Author(s)
P. BROUARD
C. JUTARD
C. COUSIN
E. COGET
Why was it done?
The Oncology Pharmacy Unit within the hospital pharmacy is experiencing a steady increase in activity. Medical teams are increasingly calling on pharmacy interns for technical and clinical questions.
What was done?
To enhance the training of pharmacy interns and improve responsiveness to medical inquiries, an artificial intelligence (AI) driven pharmaceutical chatbot pre-configured using a dedicated prompt. It was developed to deliver accurate, context-specific answers on clinical pharmacy, pharmaceutical technology, and organizational aspects of the oncology unit. This study aims to assess the relevance and quality of its responses to evaluate its potential as a support tool in intern training.
How was it done?
A total of 123 anonymized documents, including procedures, educational materials, and internal resources from the oncology unit of the hospital pharmacy, were integrated into a dedicated chatbot developed with ChatGPT-5. Forty questions reflecting eight key thematic areas of residents’ activities—clinical and technological validation, outpatient dispensing, controlled atmosphere areas, medical staff inquiries, software use, routine practice, and on-call situations—were submitted to the AI. Four experts pharmacists independently assessed each response using a standardized evaluation form with four levels of agreement (“Agree,” “Somewhat agree,” “Somewhat disagree,” “Disagree”).
What has been achieved?
Among the 160 responses received, a strong inter-rater consistency was observed, with 90% of evaluations showing concordance among at least three assessors and full unanimity in 20% of cases. Overall, 79% of chatbot responses were rated favorably (41% “Agree,” 38% “Somewhat agree”). The highest satisfaction rates were found in clinical pharmacy (95%), controlled atmosphere areas (95%), and software (90%). In contrast, lower agreement occurred in pharmaceutical technology (65% favorable, 30% disagreement) and particularly in on-call situations, where 55% of responses were considered unsatisfactory.
What next?
These findings confirm the educational potential of this tool, with most answers deemed relevant. Nonetheless, discrepancies underline its limitations regarding specific technical data, including occasional hallucinatory, incorrect, or incomplete responses that lack adequate reference to institutional procedures. Given its potential, we are working to improve this chatbot by refining the prompt, updating the database, and testing other non-hallucinatory AI models.
STRUCTURED INNOVATION GOVERNANCE: AN INTERPROFESSIONAL COMMITTEE IN HOSPITAL PHARMACY
European Statement
Introductory Statements and Governance
Author(s)
Vanusa Barbosa Pinto, Cleuber Esteves Chaves, Andréa Cássia Pereira Sforsin, , Priscila Faria França, Mayara Araújo Dias, Erik Magnus Lindh, Caroline Sandoli de Almeida Souza, Maria Cleusa Martins, Maristela Barros De Sousa, Rafael Alves de Souza,
Why was it done?
We implemented a structured, interprofessional Innovation Committee within the hospital pharmacy to systematically manage the entire innovation pipeline. The team, comprising pharmacists, nutritionists, physicians, and Information Technology (IT) specialists, established a formal process to guide high-potential projects from initial ideation to final submission for competitive funding. This governance model was successfully applied in 2025 at the pharmacy of a public teaching hospital.
What was done?
Innovation often lacks strategic coordination in hospital pharmacy, limiting the translation of valuable ideas into robust projects. Our objective was to overcome this unstructured environment by creating a governance framework. The committee began its work by specifically focusing on identifying deep clinical “pain points,” such as fragmentation in antimicrobial management, difficulty in customizing medication dosages, and low adherence to training programs for Generation Z staff.
How was it done?
Projects were prioritized based on a methodology that weighed clinical impact, economic feasibility, and technical executability. The team utilized agile management tools, including the value-versus-effort matrix and the problem-solution canvas, complemented by sprint rituals to ensure progress and alignment. The committee successfully generated and developed three large, scalable proposals, validating the model’s capacity to identify and mature high-impact ideas. These proposals were submitted to a competitive institutional innovation grant (In.Cube-InovaHC).
What has been achieved?
The structured process resulted in a robust innovation pipeline with three high-potential proposals: PrintPharma (3D-printed personalized medications), FarmáciaLab (a gamified platform for team training), and Sentinela-ATB (an antimicrobial stewardship hub). The PrintPharma project, which aimed to develop an in-hospital 3D printing solution for personalized medicines, was ranked 8th among 134 highly competitive proposals in a major institutional innovation grant (In.Cube-InovaHC). This ranking validated the quality and maturity of the committee’s output.
What next?
This structured, pharmacy-managed innovation pipeline is a feasible and high-impact strategy that significantly strengthens the institution’s capacity to drive change. It should be considered a best practice example because the governance model and its agile tools are fully replicable and adaptable by any other hospital pharmacy, establishing the pharmacist as a protagonist in healthcare innovation.
CAPTURE DATA AND CONQUER CLOTS (submitted in 2019)
Pdf
European Statement
Patient Safety and Quality Assurance
Why was it done?
VTE is a collective term for blood clots usually in the legs or lungs. In Europe, there are 544,000 VTE-related deaths every year. VTE is responsible for more deaths than AIDS, breast cancer, prostate cancer and motor vehicle accidents combined. SVPH Pharmacy Department has been conducting annual Clinical Audits on VTE prophylaxis using a paper based system. However, the process was time consuming and limited the frequency of audit and the opportunities for identifying opportunities for improvement in compliance. SVPH has a high number of patients with high risk of VTE including Medical Oncology patients and Surgical patients. Compliance rates over preceding years were running at 75%; however, it is hoped to achieve a target of 90% compliance by 2020.
What was done?
An App was developed to collect data on venous thromboembolism (VTE) prophylaxis compliance across St Vincent’s Private Hospital (SVPH)
How was it done?
Different technologies were explored and an App developer was selected. Funding was sourced. Stakeholders were invited to get involved in the development team; this part was challenging and a lot of negotiations were had as to how the format of the App would be developed and carried forward. The next step when all the details had been finalised was launching the App.
What has been achieved?
Every month seven patients are randomly selected for audit and an auditor (in SVPH a pharmacist) inputs the data on the App which the lead auditor analysis. At SVPH compliance has increased from 75% prior to the app, to post implementation of the App where monthly VTE audits were conducted on all inpatient wards. The results are 92% compliance with VTE prophylaxis for 2018, and for 2019 up to Sept 2019 96% compliance.
What next?
It is hoped that this App will be a useful tool that will help SVPH and other hospitals to achieve a higher compliance with VTE prophylaxis guidelines and help prevent clots in patients. This App can be customised to individual hospital requirements. Technology has been shown to assist with clinical audit and will be used in various projects to make auditing easier and faster and therefore help healthcare workers to provide a better service to patients.