return icon Vietnamnet.vn

Vietnamese engineer generates music with AI

Nguyen Hoang Bao Dai, a 27-year-old engineer based in Ho Chi Minh City, has become the third Vietnamese person to be recognised as a Google Developer Expert in Machine Learning for his music generation model,

 which can generate Vietnamese pop songs using Artificial Intelligence (AI).

{keywords}
AI researcher Nguyen Hoang Bao Dai.


Since graduating in computer science at the Ho Chi Minh City University of Natural Sciences, Nguyen Hoang Bao Dai has been working as an AI research engineer in natural language processing and computer vision. In addition to his passion for computer science, Bao Dai has also been interested in music since childhood. He is the composer and performer of the music video entitled ‘Dan IT’ (IT programmers) that has won much interest from viewers on YouTube.

Bao Dai said that he often works on the melody first, then the chords and lyrics because he thinks that a good song must first have a beautiful melody. During the composition period, Dai finds that creating melody is the most time-consuming stage with many songs taking him months to complete after editing the melodies many times.

This fact brought him to the idea of his applying knowledge of AI to support his passion for music. “I think that if AI can draw pictures, it can write music, too. Therefore, I plan to create an AI model that can generate music according to Vietnamese people’s musical tastes," said Bao Dai.

He embarked on research for the project in early 2017. After two years of research, his music generation model with AI debuted and has surprised people by generating ten melodies within just one second. Under his model, the composer only needs to input a few notes, the system will process the data, convert it into a multi-digit vector and create longer melodies.

The AI's random algorithm allows the system to generate completely different versions of the tune so that composers can select and make adjustments as desired. This model helps musicians shorten their working time by suggesting melodies which they may find inspiring, so that musicians have more time to refine the remaining stages, such as writing harmony, lyrics, and the arrangement of the song.

According to Bao Dai, there have been researches on AI models in generating music around the world, but most of the models work on classical music, which is very different from the musical tastes of Vietnamese people.

Therefore, Dai had to build his own algorithms for his model generate pop ballads which win much favoured of Vietnamese people. The biggest challenge for the project is to collect an input data source which is abundant enough to “train” the model. In order for the model to be able to compose young music, it must have a data source about young music. However, this data cannot be extracted from YouTube songs or music websites because these are finished products, while the system can only read and understand input data in the form of MIDI files.

To solve this problem, Bao Dai had to play and record the tunes of popular Vietnamese songs on the electric piano by himself and then processed them into MIDI files. Among the 30,000 song files that the model has stored, only about 5,000 of them were sourced from music forums while the remaining 25,000 songs were played by Bao Dai himself.

Bao Dai also faced challenges regarding the operating system, because desktops or laptops do not have enough computing power to train AI, while his budget couldn’t afford to invest in a new powerful operating system. Therefore, Dai decided to rent a machine using cloud computing and paying fees according to usage.

When questioned on whether the AI music generating model may increase the dependence on technology and limit the musician's creativity and ability in music production, Bao Dai said that the model only helps composers save time in generating music by providing reference and options rather than an almighty tool to replace humans in music. He stressed that each music product must convey the unique style, emotion and personal signature of the musician in order to gain a place in listeners’ hearts, which are irreplaceable.

Bao Dai revealed he will continue to conduct research to further develop the ability to make chords and write lyrics for his model so that it can become an effective assistant for musicians while fully optimising the features of the model.

Source: Nhan Dan

Young indie bands are top trendsetters in Vietnam's music scene

Young indie bands are top trendsetters in Vietnam's music scene

Vietnamese music in recent years has become more diverse with the appearance of many young bands with creative styles and unique musical identities.

MORE NEWS

Majority back to work after Tet in southern industrial hubs

The majority of workers of businesses and factories in Ho Chi Minh City, Binh Duong and Dong Nai provinces, three major industrial hubs in the south, have returned to work after a long Lunar New Year (Tet) holiday, local authorities said.

Pu Luong – a paradise amidst jungle for travellers on budget

Located in the north central province of Thanh Hoa, Pu Luong is renowned as an ideal destination for trekkers and budget travellers because of its seclusion and fantastic scenery of terraced rice fields and primary forests.

Vietnam joins “golden triangle of startups” in Southeast Asia: Hongkong newspaper

Lianhe Zaobao newspaper in Hong Kong (China) has run an article analysing Vietnam’s advantages that make the country the third pillar of the "golden triangle of startups" in Southeast Asia, together with Indonesia and Singapore.

Many Vietnamese spices removed from EU's control list

A number of herbs and spices imported by the European Union (EU) from Vietnam will face fewer checks when entering the bloc.

Second-hand products becoming more popular in Vietnam

The consumption habits of Vietnamese people are changing after the COVID-19 pandemic, with many using second-hand products to save money and promote sustainability.

18,000 tourists spend $18.3 million on foreign tours during Lunar New Year

The number of tourists choosing foreign tours accounted for 55 to 65 per cent of the total domestic and foreign tours.

Vietnam posts trade surplus of US$3.6 billion in January

Despite decreases in both imports and exports, the country still enjoyed a trade surplus of 3.6 billion USD in the first month of 2023, according to the General Statistics Office (GSO).

VIETNAM NEWS HEADLINES JANUARY 30

NA leader launches emulation drive, tree planting festival in Tuyen Quang

Nearly 43,900 businesses pull out of market in January

Some 43,900 businesses have withdrawn from the local market in the year to date, up 14.4% year-on-year, according to the Agency for Business Registration under the Ministry of Planning and Investment.

VIETNAM BUSINESS NEWS JANUARY 30

Retail sales of goods, services up 20% in January

Vietnam to send 20 teams to VEX Robotics World Championship 2023

Vietnam is allowed to send 20 teams to the VEX Robotics World Championship 2023 (VEX Worlds), scheduled to be held in May this year in Dallas city in the US state of Texas.

Transport Ministry backs Binh Phuoc’s airport plan

The Ministry of Transport has thrown its weight behind Binh Phuoc Province’s proposal to convert its military airfield in Hon Quan District into a specialized airport.

120-year-old stone church in Da Nang still open to visitors

Built of stone and nearly 120 years old, Tung Son church has retained its special features.

Border gates in Lang Son, Quang Ninh reopen after Tet holiday

The border gates in Quang Ninh and Lang Son provinces have resumed operation after a week-long suspension of customs clearance for the Lunar New Year holiday (Tet).

Foreign investors remain optimistic about VN stock market

Foreign investors' confidence in the Vietnamese stock market is reflected in net buying activities, especially in the last months of 2022.
back_to_top