Skip to content

Speech-based code editor #1270

Description

@amyjko

What are you trying to do that you can't?

For people who cannot do drag and drop or type on a keyboard, and find single-character on-screen keyboards slow, the current code editor is a major barrier to writing code.

What is your idea?

Let's imagine a speech-based code editor. Browsers support speech to text, so the task is designing an editor that takes the transcribed text and uses it as an interface to all existing editing commands.

One possibility is that we define templated multilingual text patterns for all commands, and an interface for someone dictating to see all commands, so they can learn the patterns of communication. We could also have system for taking an expression and finding the best guesses of which command was intended, then a quick way to select the synthesized match. The expression language could use relative spatial references (e.g., 'here').

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    accessibilityAnything related to accessibilityeditorAnything related to editing codeneeds designWhen an enhancement is not yet designedneeds researchAn enhancement that requires academic research (6+ months of study and invention)

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions