The development of computer human-computer interaction interface

Has the development of human-computer interaction interface reached its peak now? No, it is far from it. The development of human-computer interaction interface is making great strides towards natural language interaction.

At present, the Jarvis+ technical team focuses on its main technical strength, takes natural language understanding and dialogue management as the technical breakthrough, integrates and integrates other related AI technologies to launch a variety of chatbots for community users. It provides good technical services for community users, improves the human-computer interaction interface, and hopes to occupy a place in the broader dialogue-as-a-service field in the future.

Let's take a look at how the computer human-machine interface has developed with Michael from Jarvis+.

Computer human-machine interface, also known as user interface, is a medium and dialogue interface for transmitting and exchanging information between people and computers, and is an important part of computer systems. Computer human-machine interface is a medium for interaction and information exchange between the system and the user. It realizes the conversion between the internal form of information (binary data) and the form acceptable to humans, such as text, images and sounds. Human-computer interface exists in all fields involving information exchange between computer users and computer systems. Throughout the decades of computer technology development history, each change in human-computer interface has brought about a major leap in computer applications and computer technology.

Since the birth of computers, it is inevitable to input various information, such as operating instructions and data information. Now people can easily complete operations such as shopping, video browsing, reading, etc. by pointing and clicking on their mobile phones. But the human-computer interface of early computers was not so simple. People relied on the punched paper tape in the figure below to input instructions and data to the earliest computers. Drill holes at specific positions on the punched paper tape to represent a certain character or number, and then put it into the computer's punched paper tape recognition device. The device understands the computer user's input through the different light transmittances on the paper tape.

This human-computer interaction method is very cumbersome. If people input a long instruction and punch a hole in the middle, they have to make a new punch tape. And after the information is input into the computer, they have to wait for the computer to calculate, and then read the calculation result through the punch tape output by the computer. This kind of computer is only suitable for very professional people.

Later, people transplanted the typewriter keyboard and cathode ray tube display to the computer, and people could input data and instructions to the computer by tapping the computer keyboard. If the input was wrong, the backspace key on the keyboard could be used to delete the wrong information and re-enter it. The emergence of the keyboard improved the previous task-based calculation into an interactive calculation. The operator could watch the results while inputting. The efficiency of human-computer interaction was greatly improved, and computers began to become popular.

Then, Douglas Engelbart, a Ph.D. from the University of California, Berkeley, invented the mouse. Douglas Engelbart had long been thinking about how to make computer operation easier and what means to use to replace the cumbersome instructions entered by keyboard to improve the human-computer interaction interface. The emergence of the mouse has greatly improved the experience of human-computer interaction. In the past, data and information had to be entered by multiple taps on the keyboard, but now it can be done with a few clicks of the mouse. After Steve Jobs, the former founder of Apple, invented the computer graphical interface, it brought a broader prospect for the application of the mouse. Microsoft has made the mouse a standard feature of computers through the graphical interface Windows operating system, making computers a household appliance in every family and greatly expanding the user group and computer market of computers. The popularity of the mouse has also led to unprecedented development of personal computer games. Popular games such as "Age of Empires", "Counter-Strike" and "League of Legends" are all operated by the combination of mouse and keyboard. The improvement of the human-computer interaction interface of the mouse has laid the foundation for the great development of the personal computer game industry.

Jobs was also revolutionizing the field of personal handheld devices. Previously, Nokia's mobile phones occupied the vast majority of the market share. At its most glorious moment, Nokia even advertised the slogan "Every time you blink, the world will sell four Nokia phones." Although Nokia phones can also browse simple web pages, the problem that the phone screen is too small and requires keyboard input made Jobs see business opportunities. Apple's iPhone features a high-resolution large screen, multi-touch interaction and minimalist buttons (only one). This design has brought the iPhone's human-computer interaction experience to a very high level. In less than a decade, Apple became the company with the highest market value in the world, while the conservative Nokia company directly withdrew from the mobile phone market.

So, is this the peak of human-computer interaction interface? No, it is far from it! The development of human-computer interaction interface is making great strides towards natural language interaction. It is still troublesome for people to point and click on the device. If the computer can understand human language and human thoughts, it will be a greater progress. So the concept of dialogue as a service was proposed. In many scenarios, the conversational user interface (CUI-Conversational User Interface) is more natural and efficient than the graphical user interface (GUI-Graphical User Interface). In the past few years, the conversational user interface has received a lot of attention and has achieved rapid development. It is also the focus of major manufacturers in the field of AI. Apple's Siri, Microsoft's Xiaobing and other dialogue-as-a-service products are the products of major manufacturers' continuous exploration in this field.

The human-computer interaction interface of Dialogue as a Service is based on AI technology and is a comprehensive field integrating AI technologies from multiple fields. This field mainly includes five AI technology fields:

1) Automatic speech recognition (ASR) converts the original speech signal into text information;

2) Natural language understanding (NLU) converts the recognized text information into semantic representations that can be understood by machines;

3) Dialogue Management (DM) determines what action the system should take based on the state of the dialogue. The action here can be understood as what the machine needs to express;

4) Natural Language Generation (NLG) converts system actions into natural language text;

5) Text-to-speech (TTS) converts natural language text into speech output for users.

Among these five major AI technology fields, most technology companies focus on one or two technology fields for exploration. At present, the Jarvis+ technical team focuses on the main technical strength, takes natural language understanding and dialogue management as the technical breakthrough, integrates and integrates other related AI technologies to launch a variety of chatbots for community users. Provide good technical services for community users, improve the human-computer interaction interface, and hope to occupy a place in the broader dialogue-as-a-service field in the future.