ISE599: Engineering Approaches to Music Perception and Cognition

Week 1 (15 Jan 2003): An Overview of Music Concepts



Notes by Y.-C.Chen, Austin Lai, C.Y.Lee, Andy Lee, Frances Kao, Arpi Mardirossian, Xumei Tan, Erdem Unal, Phillip Wu, Shivani Yardi on

"Musical Composition and Artificial Intelligence: Some precedents and prospects"
by Jean-Claude RISSET, keynote speech in ICMAI 2002


Yun-Ching CHEN

This paper first describes the history of artificial intelligence on musical representaion, then it gives many examples in AI musical composition operation. There is a sentence showing in the paper :"Many people argue that artificial intelligence remains too crude to deal with such a complex as music...". It gives the best description of how people think about computational music cognition at the first begining.

Actually, this is my first time read a "keynote". I don't really understand some parts of this note, for example, the numbers and asterisk between paragraph (15****....).


Austin (Po-Lin) LAI

As for the other article indeed talks about AI, I really love Debussy's "work of art make rules, but rules do not make works of art." AI got some progress gradually, but I just can't appreciate the elaborating to imitate human beings. I saw an AI program project that you give it pieces like wheels, bars, or cubs, the computer can assemble a machine which can move! It was really exciting, but that's engineering. When talking about art, emotion, it's a different world within the soul. Yeah, the picture drew under the mathematical function Fractals, may look very garish. But will your heart be touched? When we try to understand human recognition through modeling, try to make a machine that can love, I simply believe that there is something can't be represented by math, something beyond the physics laws.


Chia-Ying LEE

This paper gives us a retrospective about the progress of artificial intelligence in music. The topics include stochastic composition, automatic composition, artificial acoustics and perceptual idiosyncrasies.

Stochastic composition uses random methods to compose. Random methods are various, for example, the composer can random select the notes and rhythm, or he can first define a melody contour then select the notes randomly. In some computer music experiments, many different compositions were automatically generated by introducing music grammars and altering parameters. Hence, computers can be an assistant to composers, but the creation of music is still from human; the artificial creativity based on formulae is very limited.

Some efforts in computer music are about the interactive between computers and composers or performers. For example, in real-time composition, the program can capture the gesture of the composer and control compositional parameters, and some computer programs can accompany the performer of a musical instrument. Another possibility of computer music is on the sound itself. With computer synthesis, one can alter the texture of the sound or cause various figures to stand out from an indistinct background.


Andy LEE

It's a happy experience to read this speech transcription. Risset went through all the history of machine-made music, even thought his conclusion is not so happy for engineers. They believe they can create everything. However, I like the one Risset quote Debussy: "works of art make rules, but rules do not make works of art". This is like a trapped-door one-way function. Only God has the key to do it reversely. We just do our best to approach it. Thus, in page 18, Risset mentioned about the music for therapy. I am curious about it. There are many CDs claim that they can help sleeping or cure some diseases. Is this possible or just for marketing?


Frances KAO

This speech is generally a retrospect of algorithmic music composing, and music-related achievement in artificial intelligence.

Before computer is used on composition, scientists and composers got together using so-called stochastic composition approach to make music pieces. After computers are available, the approach taken was toward grammar-based, in which computer programs implement some rules.

The newest and latest approach of computer-assisted composition is artificial intelligence; however it is not without limitation, such as lacking some kind of originality. Therefore here comes another approach toward artificial intelligence, to simulate the environment rather than the subject (i.e. human), and the difficulty we are dealing with is how to make computers precisely (or nearly so) portray human reaction to music.

Reference about the topic: The History of Algorithmic Composition.


Arpi MARDIROSSIAN

This article is mainly a summary of the individuals who, throughout history, have used some kind of artificial intelligence to compose music.

First in this discussion are the individuals who used some method to randomly select musical chords in a given tonality and assemble them into simple compositions according to certain rules. They include John Pierce, Elizabeth Shannon, and Raymond Queneau. Also mentioned was Lady Lovelace.

The next set of individuals discussed were those who, in the fifties, were able to use computers. Some of the things they focused on included computer synthesis of sound, compositional algorithms, performing harmonization, and using eye-tracking to activate some sort of musical event.

Also discussed were programs that would select musical elements (pitches, durations) at random, and then screen them through a filter of restrictive constraints. These researchers also dealt with the concern of statistical distribution. In this period, there was a spirit of both rigor and innovation. Composers insisted on specifying rules and not modifying anything in compositions produced by a program. The concern about renovating the grammar of music was influenced by the developments in information theory, linguistics and computer science.

Another wave of interest in research has been real-time activity. Discussed was a real-time computer accompaniment. A computer must be able to detect when a real player is playing and to time things correctly.


Xumei TAN

The computer composition flourished from 1950s and experienced rapid development from using serial system to using stochastic composition which helps to control directly mass and densities.

The concern about renovating the grammar of music was also influenced by certain scientific development. New grammars have been formed to do computer composition. Nevertheless, computer cannot replace artist. But the collaboration between them can be very useful. Then this paper introduces the real-time operation, computer accompany, and new sonic vocabulary created by technology.

Although computer composition has a lot of advantages, it must be used very carefully. The understanding of music and the possibility how well computer can do in a specific case should be concerned before formulization.


Erdem UNAL

In this talk, Jean-Claude Risset is summarizing and giving examples of artificial intelligence in muscial composition.

The examples which are basically the early works of the subject, seems very interesting.

Computers are being able to compose music within specific rules of music. By examining musical pieces, computer programmers in the past tried to define some specific rules which they called the grammer of music and within this grammer, a computer can simply generate musical pieces. Random pitches and durations are selected by the computer and the ones which are not within the grammer are rejected and the correct random choices of pitch and the duration of notes create different music pieces. Mainly the grammer rules are simple statistical approaces to the existing musical works.

But as it is mentioned, such kind of AI will not be succesfull for everybody. Music can not be simply categorized with some statistical rules. That's what I think.

In the next part of the paper, the author is talking about a very interesting thing that is artifical accompany for a specific music. While a piaist plays a piece, the AI accompanies the music that the pianist playing and this sounds very interesting and a little inaccurate. Because computer does not know the key the chords and event it has the ability to calculate the chord or the key after a specific time it sounds very hard to me to accomplish such kind of a thing in a REAL time environment. Detecting the input may be easy with using MIDI representation but after that finding out the chord and key and detecting the rhythm that the pianist is using shuld be very hard.

And paper also talk about some issues of artifical composition such as detection of pitches that are over 5000 Hz...

Thats a summary of what I learnt from this paper...


Phillip WU

It must be a very exciting speech, since the speaker gave a lot of audio demonstration to the audience. And the music examples are what I need, because I can hardly study the RmusicS without listening to it.

The speaker told the story about the history of development of computer-composition. Some important conclusions in each period have been mentioned. Researchers tried to find the musical RvocabularyS and RgrammarS, that is, the rules to extract sounds from chaos and organize them into music. But it is a great challenge since what counts in music is not the physical relation between sounds, but the relation we perceive when we listen to them. And we didn't learn more about ourselves.

So what we could do is to tell the computer what not to do, instead of what to do. Just like we are searching a right path in a map which contains millions and millions of paths. We are far from doing the right thing, but we never do something wrong by taking away the wrong ways. And that's why, I think, the professor keeps telling me the research work in this music cognition project is knowledge-based.


Shivani YARDI

The paper by Jean Claude Risset discusses the history of progress in the field of computational algorithms in the understanding of music. About 50 years ago, people experimented by randomly selecting fragments of a musical piece and building a sensible whole from those blocks based on intuition. later on, the focus was on the wise selection of various music parameters such as pitch, tone, etc. Based upon observations, a number of rules were established which laid constraints on the final structure. These rules, when quantified led to the idea of developing 'compositional algorithms' . Research is being carried out in the area of AI where one can train a machine to ape the thought process of a musician so that it can accompany him/her in real time. This involves the study of behaviour of a composer and the ability to extract the nearly exact attributes of the composer's style.



Posted 22 Jan 2003
The University of Southern California does not screen or control the content on this website and thus does not guarantee the accuracy, integrity, or quality of such content. All content on this website is provided by and is the sole responsibility of the person from which such content originated, and such content does not necessarily reflect the opinions of the University administration or the Board of Trustees