PhD study: Testing a new UX design method for LLMs

🔑 Enhanced Key Takeaways

• •The concept of 'calibrated trust' is critical in human-AI collaboration, as both over-reliance (leading to cascading errors) and under-trust (resulting in underutilization) can be detrimental to effective system use.
• •Current research on trust calibration in AI often approaches explanations from a model-centric perspective, focusing on making AI models interpretable rather than providing human-centered UX design guidelines for effective trust calibration.
• •The PhD study aims to bridge this gap by developing a structured method that assists designers and developers in selecting and applying appropriate trust-related interface elements within LLM chatbots, tailored to specific use contexts.
• •Factors influencing trust calibration in LLM interactions extend beyond technical performance to include user-related aspects such as expertise, prior experience, expectancy, perceived risk, decision stakes, and even intuition for detecting hallucinations.
• •Designing user experiences for LLMs presents unique challenges compared to traditional chatbots due to the non-deterministic nature of LLMs, requiring interfaces that facilitate communication between the user and the unpredictable AI.

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline