Wednesday, August 30, 2017

Alquist made it to the Alexa finals


The CVUT Alquist team managed to get with other two teams to the finals of a $2.5 million Alexa Prize, university competition. Our team has developed the Alquist social bot.

The whole team has met in the eClub during summer 2016. That time we have been working on a question answering system YodaQA. YodaQA is a somewhat complex system, and students learned the classic NLP. Of course, everybody wanted to use Neural Networks and design End to End systems. That time we have also been playing with simple conversational systems for home automation. Surprisingly Amazon announced the Alexa Prize and all clicked together.  We have quickly put together the team and submitted a proposal. One Ph.D., three MSc, and one BSc student completed a team with strong experience in NLP. In the beginning, we have been competing with more than a hundred academic teams trying to get to the top twelve and receive the 100k USD scholarship funding. We were lucky, and once we were selected in November 2016, we began working hard.  We started with many different incarnations of NNs (LSTM, GRU, attention NN, ....) but soon we have realized the bigger problem, a lack of high-quality training data. We tried to use many, movies scripts, Reddit dialogues, and many others with mixed results. The systems performed poorly. Sometimes they picked an interesting answer, but mostly the replies were very generic and boring. We have humbly returned to the classical information retrieval approach with a bunch of rules. The final design is a combination of the traditional approach and some NNs. We have finally managed to put together at least a little reasonable system keeping up with a human for at least tenths of seconds. Here started the forced labor. We have invented and implemented several paradigms for authoring the dialogues and acquiring knowledge from the Internet. As a first topic, we have chosen movies since it is also our favorite topic. Then, we have step by step added more and more other dialogues. While perfecting dialogues, we have been improving the IR algorithms. We had improved the user experience when Amazon introduced the SSML. Since then Alexa voice started to sound more natural.

While developing Alquist, we have gained a lot of experience. A significant change is a fact that we have to look at Alquist more as a product than an interesting university experiment. The consequences are dramatic. We need to keep Alquist running, which means we must very well test a new version. Conversational applications testing is by itself a research problem. We have designed software to evaluate users behavior statistically. First, a task is to find dialogues problems, misunderstanding, etc. Second, we try to estimate how happy are users with particular parts of the conversation to make further improvements. Thanks to the Amazon we have reasonably significant traffic, and while we are storing all conversations, we can accumulate a large amount of data for new experiments. Extensive data is a necessary condition for training more advanced systems. We have many new ideas in mind for enhancing the dialogues. We will report about them in future posts.

Many thanks for the scholarship go to Amazon since it was a real blessing for our team. It helped us to keep the team together with a single focus for a real task. Students worked hard for more than ten months, and it helped us to be successful.

Today we are thrilled we made it to the finals with the University of Washington in Seattle and their Sounding Board and the wild card team from Heriot-Watt University in Edinburgh, Scotland, with their What’s up Bot. Celebrate with us and keep the fingers crossed. There is a half a million at stake.

31 comments:

  1. Huge data is an important circumstance for education extra advanced systems. you have many new ideas in thoughts for enhancing the dialogues, I'm able to file about them in future posts and referred to others.

    ReplyDelete
  2. Thanks for posting your valuable thoughts with us & our readers. Please keep continue writing on this blog.
    Bulk SMS Provider

    ReplyDelete
  3. I really appreciate your professional approach.These are pieces of very useful information that will be of great use for me in future.

    ดูหนังใหม่

    ReplyDelete
  4. Katerina PapežováJanuary 19, 2018 at 9:52 AM

    Hello Mr. Sedivy,
    First of all, I want to congratulate your team for this huge success.
    It great when our country is not well known just for our sportsmen and president.
    This success in IT is great.

    I read the article about it and I'm very interested to invite you or the whole team, to talk about it in our company name Actum, placed on Prague 4.
    We have our internal lectures called Actum Academy, where we're inviting internal and external speakers to talk about some interesting topics.
    As soon we're IT company focused on SW development and recently also for IoT, your story will be very interesting for us.

    If you'll be interested, you can reach me on my email (katerina.papezova@wmcgroup.cz).

    If not, anyway, I congratulate you and wish you more success in your future job.

    Regards

    Katka

    ReplyDelete
  5. Join us. We have now nice assets, free online movies a lot of experience and dollars to award you scholarships.

    ReplyDelete
  6. Great goods from you, man. I have understand your stuff previous to and you are just extremely magnificent.
    I really like what you've acquired here, certainly like what you're saying and the way
    in which you say it. You make it entertaining and you still take care of to keep it smart.
    I can't wait to read much more from you. This is actually
    a wonderful site.

    ReplyDelete
  7. Nice blog and absolutely outstanding. You can do something much better but i still say this perfect.Keep trying for the best. Hire iPhone Developers India

    ReplyDelete
  8. kompasqq menyediakan 8 permainan dalam 1 id
    Bonus - Bonus yang di berikan Menarik Loh !
    Info Selajutnya kalian Bisa Add BBM
    Yohanna: 7BD4C69C
    Phone : +855011432145
    WA: 085220150616

    ReplyDelete
  9. India Data Entry Services is a trusted Amazon Bulk Product Upload Services provider to e-commerce companies and platforms. Be it e-commerce product cataloguing or Product Upload Services, since our inception in 2010, we are striving to get all best o cater global organizations. The company is strategically positioned to support big or small e-Commerce Stores working on various domains such as fashion apparels, crockery items, furniture, accessories, shoes, bags, technology and much more. We house dedicated professionals who are assigned to separate divisions that are deftly managing Ecommerce Product Data Entry Services, specification and attributes for web stores, online retailers and eCommerce catalog companies.

    ReplyDelete
  10. hi thanks, Our Services are the best Professional Web Design Service Company in Delhi, We are Doing worked from Website Designing Company in India.
    website designing services | Website Designing Company in Delhi | top website design services

    ReplyDelete
  11. It will be the very simple steps to interact with our Doha Escorts. We simply provided our official number at this web page.

    ReplyDelete
  12. We provide the technology infrastructure and marketing reach to help merchants, brands and other businesses to leverage the power of new technology to engage with their users selling on etsy,com from Pakistanand customers and operate in a more efficient way.

    ReplyDelete
  13. Goyal packers and movers in Panchkula is highly known for their professional and genuine packing and moving services. We are top leading and certified relocation services providers in Chandigarh deals all over India. To get more information, call us.

    Packers and movers in Chandigarh
    Packers and movers in Panchkula
    Packers and movers in Mohali
    Packers and movers in Zirakpur
    Packers and movers in Patiala
    Packers and movers in Ambala
    Packers and movers in Ambala cantt
    Packers and movers in Pathankot
    Packers and movers in Jalandhar
    Packers and movers in Ludhiana

    ReplyDelete
  14. This is really a well-needed platform for the readers all over because you always come up with something interesting and new so that we could make an essential read from here. well about last night l visit Yummy kabob in Annandale and you know what From the spices of India and Doha, to the culinary traditions of Jordan to the hospitality of the UAE, Yummy Kabob uses the finest grades of Halal Meat and the freshest sea food.

    ReplyDelete
  15. Hey thanks for sharing this information.

    If you have any type of technical errors with you Facebook account and want to get overcome from it then make a call to our experts by dialing Facebook Support Number +(1) 877 207 4415

    ReplyDelete
  16. https://www.kitoinfocom.com/services/mobile-apps-development-company-india.php

    ReplyDelete
  17. If you want app with advance features then choose
    Mobile Android App Development Company Based in Delhi India who have experienced engineers of this field.

    ReplyDelete

  18. نجار بالمدينة المنورة
    مما لا شك فيه أن نجار بالمدينة المنورة من أهم العمال التي يعتمد عليهم في تنفيذ الكثير من الأعمال التي تخص مهنة النجارة، وهي واحدة من المهن الصناعية التي لا حياة دونها فمعلم نجار بالمدينة المنورة هو الذي يكون بمقدورته القيام بفك وتركيب غرف النوم بالمدينة المنورة، يعمل على فكر اثاث بالمدينة المنورة كما يستعين به في أعمال نقل العفش والأثاث، كما يمكنه القيام بتركيب المطابخ بمختلف أشكالها وأنواع وتركيب الأبواب والنوافذ الخشبية، حيث أن لديه خبرة كبيرة جداً تجعله من أهم الكوادر التي تعتمد عليها شركة أحباب طيبة.

    ReplyDelete
  19. Thanks for sharing this information. It is very useful to our site. Are you searching the best mobile apps development and consulting service at affordable price. Our company is the best choice for you.
    For any details Ecommerce Consulting Company in Houston

    ReplyDelete
  20. Cari Situs Judi Online Terpercaya? Teraman? Banyak Bonusnya?
    Di Sini Tempatnya.

    ZumaQQ, Agen BandarQ, Domino99, Poker Online Terpercaya

    Hanya 4 Tahapan Kemenangan yang MUDAH di ZumaQQ
    Daftar > Depo > Main > Menang!
    Deposit minimal Rp. 20.000,-
    Anda Bisa Menjadi JUTAWAN? Kenapa Tidak?
    Dengan 1 ID sudah bisa bermain 8 Jenis Permainan
    * BandarQ (HOT)
    * Bandar 66 (New Hot)
    * Bandar Poker
    * Sakong Online
    * Domino QQ
    * Adu Q
    * Poker
    * Capsa Susun
    Ada Juga Bonus Terhot Se-Indonesia
    Bonus Turnover 0,5%
    Bonus Refferal 10% + 10%

    Yuk gabung bersama kami dan Jadilah Jutawan Berikutnya!
    BBM : ZumaQQ
    WA : +855974237630
    Line : ZumaQQ
    Forum 1 : Forum ZumaQQ
    Forum 2 : Forum ZumaQQ
    Forum 3 : Forum ZumaQQ
    Blog 1 : Info Kemenangan
    Blog 2 : Agen BandarQ
    Blog 3 : Poker OnlineQ
    Blog 4 : BandarQ OnlineQ
    Blog 5 : Sakong OnlineQ
    Blog 6 : Daftar Poker

    ReplyDelete
  21. Kasir4D Agen Togel Bandar Togel Dan Casino Online Terpercaya

    Menghadirkan pasaran togel resmi dan games casino online yang seru yang dapat anda bermain di dalam nya dengan kenyamanan dan keamanan yang sangat terjamin

    Bonus dan discount menarik yang menanti anda di Kasir4D
    Bonus Deposit Harian 10%
    Bonus Cashback 5% Up 15%
    Bonus Refferal 2% Setiap harinya
    Bonus Bulanan Turn Over
    Dan Masih Banyak Bonus Menarik Lainnya Menanti Anda

    Jadwal Tutup Pasaran Togel :
    Pasaran Sydney
    Tutup : 12.20 WIB & Buka : 14.00 WIB
    Pasaran Singapore
    Tutup : 17.20 WIB & Buka : 17.45 WIB
    Pasaran Hongkong
    Tutup : 22.10 WIB & Buka : 23.00 WIB

    Kunjungi :
    Webiste : Kasir4D
    What's App : +855974247219
    TELEGRAM : +6281393706188
    LINE : kasir4d
    Facebook : Kasir4D
    Twitter : Kasir4D
    Prediksi : PREDIKSI TOGEL
    Blog : Kasir4D

    Situs - situs Games Recommed Terbaik Dan Terbesar
    Agen Domino99
    Agen BandarQ
    Agen Togel Online
    Casino Online

    ReplyDelete
  22. Great information shared through this post. It helps me in many ways.Thanks for posting this again. We are top Website Development Company in Delhi & Web Designing Company in Gurgaon.

    ReplyDelete