Throughout the history of art in the world, the development of science and technology is closely related to the development of art, from the church chants in the medieval era of farming to the symphony achieved after the emergence of smelting technology in the Industrial Revolution. With the emergence of Electronic technology and computers, electronic music, MIDI, and computers Music and music artificial intelligence are developing rapidly. Is the future concert related to computers and artificial intelligence? It is very possible. We don’t know what the future music will be like, but the future music is worth exploring.
Music and the development of artificial intelligence
The development of foreign music and technology-related disciplines began in the 1950s. Engineers and scientists began to cooperate to explore the digital processing technology of music, and gradually formed the interdisciplinary music technology/computer music (Music Technology/Computer Music). After the 1970s, many large-scale computer music research institutions have been established in Europe and the United States. After 2000, music technology has gradually developed in places around the world such as Australia, Japan, and Singapore.
Since the 1990s, some professors of computer majors in various comprehensive universities in China have begun to study computers and music. In recent years, a number of domestic first-class art academies such as the Central Conservatory of Music, the Central Academy of Fine Arts, and the Shanghai Conservatory of Music have successively established cross-disciplines of art and technology, and have carried out preliminary explorations on the cross-study of music or other arts and artificial intelligence.
The Central Conservatory of Music is the first art school in my country to carry out cross-study of music and artificial intelligence: the Electronic Music Center was established in 1993, the Music Technology Department was established in 2012, and the discipline and actual system of music artificial intelligence and music information technology was established in 2018. Music artificial intelligence, electronic music composition, electronic music production, sound art direction, music therapy, artistic voice and other professional directions. The World Music Artificial Intelligence Conference held in Beijing some time ago was organized by the Music Artificial Intelligence Department. The organizers were the Central Conservatory of Music and the China Artificial Intelligence Society, which united the world’s top first-line artificial intelligence music experts. Next year, we will strive to do more, hoping that it will become a weather vane of world music artificial intelligence and an important academic exchange place, a platform for industrialized exchanges and a link to serve the society.
Roundtable discussion at the World Music Artificial Intelligence Conference
Artificial intelligence and art are currently receiving widespread attention. At the China Artificial Intelligence and Art Education Forum held in Xi’an last year, nearly 500,000 people participated in the forum online. We found that there are a lot of people all over the country paying attention to this matter. The Global Artificial Intelligence Technology Conference (GAITC) held in 2021-when AI meets art thematic forum, also hundreds of thousands of people participated.
This year, the Chinese Association for Artificial Intelligence (CAAI) Art and Artificial Intelligence Committee and the Chinese Computer Society (CCF) Computational Art Branch have been established successively, uniting all science-related personnel in the eight major art categories in the country, including the Central Conservatory of Music and Central Fine Arts Art and technology related talents from art academies such as the Shanghai Conservatory of Music and the Central Academy of Drama will discuss the future of art together.
Music artificial intelligence first music and then medicine
There are three processes in the development of music and artificial intelligence: creation, presentation, and acceptance. We study how music, humans, and artificial intelligence develop together. In addition to creation, presentation, and acceptance, there are also philosophy, the aesthetics of musical artificial intelligence, and its ethics, all of which need to be followed up by us.
In terms of music creation, there are research on composition technology, as well as smart composition and new creation methods. Intelligent composition is to create according to human’s existing laws; and the new way of creation is a process of conscious creation (by AI) that humans do not have. When we do AI composing now, we will find it to simulate the creation of human beings quite interesting, and the independent creation of simulation will make people jaw-dropping. I hope that we will create some surprises for this world in the future.
In terms of music presentation and dissemination, there are robots playing, and the Central Conservatory of Music and Indiana University have also developed an automatic accompaniment system. The original accompaniment system is that people follow the band and accompaniment tape to learn, but the current AI accompaniment system will cooperate with your performance like a human. In the future, we will automatically generate some accompaniment music.
In terms of music reception, we have conducted research and exploration in the areas of cognition, music therapy, and appreciation process. Music therapy is one of the important departments of our Department of Artificial Intelligence. There is a music therapy teaching and research center under it, which has a history of nearly 30 years. At present, in addition to traditional music therapy, the music therapy of the Central Conservatory of Music also has music human brain science, scientifically researching and constructing a larger range of music therapy, not only from the perspective of psychology, but also from the perspective of brain science. . At present, everyone has found the reaction of music memory in a certain part of the brain, which is a very small memory point. We hope to understand the frequency of music, how music forms human emotions, and what impact it has on the human brain. In fact, music has a huge impact on people’s emotions, sometimes even more than drugs, you take medicine for half a day to have an effect, but the mood changes in the moment when you listen to music, so the frequency of music is particularly magical.
The traditional Chinese character for “乐” in ancient Chinese music is “乐”, plus the beginning of the word “药” (药). “Yellow Emperor’s Internal Classic” keeps saying that music is first followed by medicine, and there are voices to cure diseases when they are cured. We hope to verify through brain science how much the frequency of sound actually responds to people, where is the response, and what is its mechanism. We want to do depression, autism, and hospice care in the future, but now we want to solve the problem of sleep as the first step and study the effect of music on sleep.
Smart composition has started
Central Music’s AI automatic composition system is a system that composes, arranges, sings, and mixes through artificial intelligence algorithms, and finally generates a complete song composition. Intelligent composition can quickly compose a song in 23 seconds, which can reach the writing level of general composers. In 23 seconds, the orchestration and singing can be released, which is relatively cutting-edge in the world.
Automatic composition system architecture
The intelligent automatic composition system is mainly divided into automatic composition module, automatic arrangement module, singing voice synthesis module and automatic mixing module. In the process of system establishment, the first step is to sort out and count the song information such as song melody, genre, emotion, lyrics, etc., and build it into a large database of information, then use deep learning algorithms to train the corresponding model, and finally the system according to the parameters input by the user Make song works with lyrics. The ultimate goal of this project is to realize a web-side product based on a web-server architecture that can be used by users.
The music of the future will definitely be a multi-dimensional music space. With the traditional stereo sound of a pair of speakers, the sound we hear comes from the front. But now many panoramic radio and recording technologies can receive sounds from all directions, and the effect is much better. 3D music will have a more moving musical charm than stereo music. It is an upgrade of traditional stereo music hearing. It is a new concept of music that cannot be experienced on TV, stereo recording, etc. at present. This kind of “running and flowing” 3D holographic music will be a part of future music. It is an innovative project of this era and is worth exploring.
In addition to the three-dimensional stereo effect produced by traditional symphony orchestras, we also have newly created music, such as electronic music creation, which is not limited to the front sound, but also through the back sound and the upper sound. All dimensions and all directions participate in the creative expression of music.Our research result
I found that the emergence of 3D music may have an impact on our traditional harmony and orchestration.
3D music will definitely change the original model. In 2019, the Central Conservatory of Music made a 3D music “Chinese Zodiac”. Now many musicians all over the world are doing it, including Dolby and DTS, which have released their own encoding and decoding systems, which gives creators more space, and they can make 3D music at home. In addition to speakers, 3D music can also be reduced to the algorithm of earphones. We can also hear three-dimensional space with earphones.
In the future, music robots and virtual robots will have important benefits for our music performance, interaction, and music entertainment. We are currently making a music robot for music education. Everyone knows that there is a shortage of music education teachers all over the world, especially in remote areas where there is a shortage of professional music teachers, and even some places have part-time physical education teachers and Chinese teachers. We hope to make some efforts in the “digital person” so that the “digital person” can interact with you as a music teacher. If virtual characters in music education can do something for the remote mountainous areas of the country, it will be a major contribution to our aesthetic education in China.
We also have an AI lyrics assisted writing system to assist composers in creating lyrics. We made a poetry system, and 80% of people couldn’t write it. We are now working as a music data and computing center. The Ministry of Education and the National Development and Reform Commission attach great importance to it. We especially hope that we will build the world’s largest music data center.
The research field of artificial intelligence in music is very wide. There are no schools in the world that specialize in artificial intelligence. Everyone has switched from voice. The subject of the Central Conservatory of Music studies the future of music. We have four research directions: artificial intelligence creation, artificial intelligence performance and interaction, intelligent music education, and music and brain science. Our graduates are particularly sought-after. Graduates of music artificial intelligence have not yet graduated, and major companies are rushing to ask for our people. What is the music of the future? Maybe we don’t know. But we can see some clues by looking at the development of music history and the development of technology. The development of science and technology will have a profound impact on our music creation, music presentation, music acceptance, and music philosophy.
I think the development of music in the future will expand in the following three dimensions:
First, traditional music (including modern music) will continue to develop; second, science and technology empowers the innovation and development of traditional music; third, new technology produces independent development of new music forms.
In short, music artificial intelligence is to help and empower mankind, not to replace human beings. Because of the emergence of musical artificial intelligence, human art will become more colorful and precious. I hope we can work together to do something for the future of music.