Tuesday, 11 August 2026

Thinking aloud with AI

AI technology, which includes AI chat interfaces and image generators, has pushed ways of ideation beyond traditional sketching on paper or digital drawing programs, such as SketchUp. Both modes are good at drawing at the speed of thought. But while visual elements are core to design, verbal language is the main means of human communication as shown by AI systems transforming speech into sketches. That is, by dictating, or thinking aloud to a Large Language Model (LLM), the program converts spoken ideas into visual sketches in real time. Or, by combining freehand drawing on screen with real-time speech input that supports more fluid ideation (sketch-and-speech fusion)*. And so, GenAI enables ideation using speech input as alternative to text or visual prompts. AI technology, then, is modifying and expanding ways of generating and communicating ideas that, moreover, can help widening participation in the design process to those not familiar with conventional ideation tools such as sketching. However, any conceptual tool depends on users' skills. * https://www.researchgate.net/publication/397480818_TalkSketch_Multimodal_Generative_AI_for_Real-time_Sketch_Ideation_with_Speech

Blog Archive