Tuesday, 11 August 2026

Thinking aloud with AI

AI technology, which includes AI chat interfaces and image generators, has pushed modes of ideation beyond traditional sketching on paper or digital drawing programs, such as SketchUp. Both modes are good at drawing at the speed of thought. But as verbal language is the main means of human communication, AI systems can now transform speech into sketches in real time. That is, by dictating, or thinking aloud to a Large Language Model (LLM), the program converts spoken ideas into visual sketches. Also a research project, called TalkSketch combines freehand drawing with real-time speech input that enables designers to sketch and speak together to support more fluid ideation*. That is, users draw freely on a tablet while simultaneously talking through their ideas (sketch-and-speech fusion). And so, GenAI enables designers to convey their ideas visually using speech input as alternative to text or visual prompts, or sketching on tablet or paper. AI technology, then, is modifying and expanding ways of generating and communicating ideas that, moreover, enables widening participation in the ideation process, particularly for those not familiar with expressing their ideas through traditional sketching. But then, any conceptual tool depends on users' skills. * https://www.researchgate.net/publication/397480818_TalkSketch_Multimodal_Generative_AI_for_Real-time_Sketch_Ideation_with_Speech

Blog Archive