We talked about technology being like music and he thought what if we were able to hear it, and feel it, and use music notation, and have people actually use technology together in a whole new different kind of way. So the coded key set was unconscious and automatic for him, just like me playing this is unconscious and automatic for me. [...] The whole idea that you could actually have instead of a piano a piano that connects the technology where we can improvise together people can be on different instruments and we could imagine futures and uses for technology

The project was to evaluate or invent pointing devices that could be used in the space capsule, because we were just starting to send astronauts up and stuff, and NASA had a big enough vision that they could see that they were going to want to have have astronauts interacting with computers.

Doug from his previous scaling studies knew that our knee movement is actually the one of the most accurate that we have in our body. And they had trackballs [...] at the time and the trackball was basically two orthogonal orthogonal wheels with a ball on top and as you rotated the ball you'd rotate the wheels, and had little digital optical things inside and so you could cut wheel rotations in the software and you can figure out where the mouse was, so Doug and Bill English came up with the idea of turning a trackball upside down and and using your wrist in your hand to move the trackball on the table rather than having the trackball with the ball facing up, [...] and that's where the idea for the original Mouse came from