Issue 60 - Teach Machines Cause and Effect

Editorial

Thoughts From Your Humble Curators

This week we take a closer look at Prof. Judea Pearl's interview with Quanta Magazine on how he thinks about the current limitations of machine learning. You can find out in our Blog section.

To those in the U.S., happy Memorial Day weekend!

As always, if you like our newsletter, feel free to subscribe and forward it to your colleagues.


This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 143,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

News


Pulse: Intel

Two pieces of news about the new Intel AI group, which released both an NLP deep learning library and the Nervana chip for accelerated AI training. By most measures, these products are not ground-breaking. However, Intel continues to chip away into the AI space.

Artificial Intelligence and Deep Learning Weekly


Blog Posts



About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 143,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

 

Issue 59 - Google I/O 2018, in particular, Duplex

Editorial

Thoughts From Your Humble Curators

This week we cover Google I/O. In particular, Google Duplex has some surprising backlashes. Check out our fact-checking section.

As always, if you like our newsletter, feel free to subscribe and forward it to your colleagues!


This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 140,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

News



Deals

Artificial Intelligence and Deep Learning Weekly


AI Summary of Google I/O 2018

Google I/O, just like last year, kept churning out interesting products:

  • Duplex, a dialogue system which sounds very close to humans with natural understanding capability,
  • Smart Compose - automatic suggestions based on machine learning,
  • TPU 3.0 - TPU 3.0, yet another upgrade of Google's revolutionary ASIC-based neural network chip,
  • Google ML Kit - Google ML Kit, more a new interface to add Google AI product to apps.

Duplex has some surprising backlashes after Google I/O. Some of these, in our view, could be misunderstanding in technicalities. See our fact-checking section on our analysis. In particular, as impressive as it is, Duplex is not AGI.

Artificial Intelligence and Deep Learning Weekly

Factchecking

Blog Posts

Video

About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 140,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

 

Issue 58 - F8 and ICLR 2018

Editorial

Thoughts From Your Humble Curators

We cover F8 this week, point you to various resources of ICLR 2018, we also analyze a now-classic paper on text summarization.

As always, if you like our newsletter, feel free to subscribe and forward it to your colleagues!


This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 136,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

News


F8 2018 AI Summary

FB 2018 was just hold on May 1st and 2nd. Many commenters noted the more sobering tone of the conference because of the Cambridge Analytica data scandal.

Our focus, of course, is AI, here are couple of interesting pieces of news:

Production-Ready PyTorch 1.0

Open sourcing Go Bot

"We salute our friends at DeepMind for doing awesome work," Facebook CTO Mike Schroepfer said in today’s keynote. "But we wondered: Are there some unanswered questions? What else can you apply these tools to."

When you lose an ML competition, you open source your code. Nothing much - while your competitor wins, you become the one who nurtures the future generation of enthusiasts. Smart move, Facebook. Here's the github.

FB improves computer vision by using instagram resources

Artificial Intelligence and Deep Learning Weekly




Deals

Artificial Intelligence and Deep Learning Weekly

Blog Posts

Open Source

Paper/Thesis Review

A read on A Neural Attention Model for Abstractive Sentence Summarization"

This is a read on the paper "A Neural Attention Model for Abstractive Sentence Summarization" by A.M. Rush, Sumit Chopra and Jason Weston.

  • Here is the arxiv, Video, Github
  • The paper was written at 2015, and is more a classic paper on NN-based summarization. It is published slightly later than classic papers on NN-based translation such as those written by Cho or Badhanau. We assume you have some basic understanding on NN-based translation and attention.
  • If you haven't worked on summarization, you can broadly think of techniques as extractive or abstractive. Given the text you want to summarize, "extractive" means you just usehe word from the input text, whereas "abstractive" means you can use any words you like, even the words which are in the input text.
  • So this is why summarization is seen as similar problem as translation: you just think that there is a "translation" from the original text to the summary.
  • Section 2 is a fairly nice mathematical background of summarization. One thing to note, the video also bring up noisy channel formulation. But as Rush said, their paper is to completely do away noisy-channel but do direct mapping.
  • The next nuance you want to look at is the type of LM and the encoder used. That can all be found in Section 3. e.g. it uses the forward NNLM proposed by Bengio. Rush mentioned that he was trying RNNLM, but at that time, he get small gain. It feels like he can probably get better results if RNNLM is used.
  • Then it's the type of encoder, there is a nice comparison between bag-of-words and attention models. Since there are words embeddings, the "bag-of-words" is actually all the input words embedded down to a certain size. Attention model, on the other hand, is what we know today, which contains a weight matrix P which map the context to input.
  • Here is an insightful note from Rush: "Informally we can think of this model as simply replacing the uniform distribution in bag-of-words with a learned soft alignment, P, between the input and the summary."
  • Section 4 is more on decoding, in Section 2, Markov assumption was made, this simplifies the decoding quite a lot. The authors were using beam search, so you can use trick such as path combination.
  • Another cute thing is that the authors also comes up with method such that make the summarization more extractive. For that it uses a log-linear model to also weigh features such as unigram to trigram. See Section 5.
  • Why would the author wants to make the summarization more extractive? That probably has to do with the metric. ROUGE usually favors words which are extracted from the input text.
  • Another note pointed out by reader at AIDL-LD is that summary usually has proper nouns and can only be found it the input text. Once again, making the summarizer extractive is more appropriate.
  • Here are several interesting commentaries about the paper. mathyouth, Denny Britz

Artificial Intelligence and Deep Learning Weekly

Contemporary Classic

About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 138,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

 

Issue 57 - Salaries of Deep Learning Researchers

Editorial

Thoughts From Your Humble Curators

In this issue, we take a closer look at AI-researchers' salaries as reported by NYT, in the Blog section we discuss the article by Prof. Michael I. Jordan.


This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 136,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

News


Deals

Artificial Intelligence and Deep Learning Weekly

Blog Posts



Open Source


About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 136,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

Issue 56 - A profile on SenseTime; How does "Hey Siri" work?

Editorial

Thoughts From Your Humble Curators

We have the profile of SenseTime this week in the News section this week, and we also analyze Apple's personalized "Hey Siri" feature in the Blog section.


This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 132,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

News


Deals

Artificial Intelligence and Deep Learning Weekly


Blog Posts



Member's Question

Maximum Number of Classes

Question: What's the maximum number of classes a classification algorithm can support ??

Answer: (By Arthur) If the objects themselves are not confusing, the answer is theoretically infinite, provided that you also have the right amount of training data for each class.

But if you want to differentiate between two objects but they are both apples, and there is no feature which you can differentiate them. Then the answer is you algorithm will only have 50% chance to come up with the right answer. This sounds funny, but it happens a lot in speech recognition where two words can have the same pronunciations.

Artificial Intelligence and Deep Learning Weekly

About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 132,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

Issue 56 - Will AI solve all problems of Facebook?

Editorial

Thoughts From Your Humble Curators

Our headline this week is Zuckerberg's Senate hearing, we look at the core technical problem Facebook encounters when it comes to fake news/profiles detection. In our Blog section, we cover DeepMind's navigation agent, Skydio R1, as well as how researchers are learning dog's behavior through AI.


As always, if you like our newsletter, feel free to forward it to your friends/colleagues!

This newsletter is a labor of love from us. All publishing costs and operating expenses are paid out of our pockets. If you like what we do, you can help defray our costs by sending a donation via link. For crypto enthusiasts, you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65.

Artificial Intelligence and Deep Learning Weekly

News


Deals

Artificial Intelligence and Deep Learning Weekly

Blog Posts





About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 131,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

Issue 55 - Will AI solve all problems of Facebook?

The definitive weekly newsletter on A.I. and Deep Learning, published by Waikit Lau and Arthur Chan. Our background spans MIT, CMU, Bessemer Venture Partners, Nuance, BBN, etc. Every week, we curate and analyze the most relevant and impactful developments in A.I.

Editorial

Thoughts From Your Humble Curators

Our headline this week is Zuckerberg's Senate hearing, we look at the core technical problem Facebook encounters when it comes to fake news/profiles detection. In our Blog section, we cover DeepMind's navigation agent, Skydio R1, as well as how researchers are learning dog's behavior through AI.


As always, if you like our newsletter, feel free to forward it to your friends/colleagues!

This newsletter is a labor of love from us. All publishing costs and operating expenses are paid out of our pockets. If you like what we do, you can help defray our costs by sending a donation via link. For crypto enthusiasts, you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65.

Artificial Intelligence and Deep Learning Weekly

News


Deals

Artificial Intelligence and Deep Learning Weekly

Blog Posts





About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 131,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

 

Issue 54 - Jeff Dean Fact: He is the new Google Chief of AI, and this is actually true!

Editorial

Thoughts From Your Humble Curators

In a major shuffle of talents, Apple hired Google AI's chief, John Giannandrea, and Jeff Dean became the new AI Chief of Google. We cover both pieces in our News section.

We also look deeper into Google's MobileNetV2 and summarized its various components.


As always, if you like our newsletter, feel free to forward it to your friends/colleagues!

This newsletter is a labor of love from us. All publishing costs and operating expenses are paid out of our pockets. If you like what we do, you can help defray our costs by sending a donation via link. For crypto enthusiasts, you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65.

Artificial Intelligence and Deep Learning Weekly

News



Deals

Artificial Intelligence and Deep Learning Weekly


Blog Posts

Open Source


Other News

About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 125,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

 

Issue 53 - GTC 2018

Editorial

Thoughts From Your Humble Curators

GTC 2018 was happening last week. So we have a special session with five items. Check out our notes on DGX-2, and Nvidia/ARM deal.


As always, if you like our newsletter, feel free to forward it to your friends/colleagues!

This newsletter is a labor of love from us. All publishing costs and operating expenses are paid out of our pockets. If you like what we do, you can help defray our costs by sending a donation via link. For crypto enthusiasts, you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65.

Artificial Intelligence and Deep Learning Weekly

GTC 2018





News

Partnership

Artificial Intelligence and Deep Learning Weekly


Deals

Artificial Intelligence and Deep Learning Weekly


About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 120,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly

AIDL Weekly #52 - AmoebaNet

Editorial

Thoughts From Your Humble Curators

The most interesting news this week is Google publishing new results from AutoML called AmoebaNet, we will take a look in the Literature Review section.


As always, if you like our newsletter, feel free to forward it to your friends/colleagues!

This newsletter is a labor of love from us. All publishing costs and operating expenses are paid out of our pockets. If you like what we do, you can help defray our costs by sending a donation via link. For crypto enthusiasts, you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65.

Artificial Intelligence and Deep Learning Weekly

News

Deals

Artificial Intelligence and Deep Learning Weekly


Blog Posts




Paper/Thesis Review

About Us

This newsletter is published by Waikit Lau and Arthur Chan. We also run Facebook's most active A.I. group with 110,000+ members and host an occasional "office hour" on YouTube. To help defray our publishing costs, you may donate via link. Or you can donate by sending Eth to this address: 0xEB44F762c58Da2200957b5cc2C04473F609eAA65. Join our community for real-time discussions with this iOS app here: https://itunes.apple.com/us/app/expertify/id969850760

Artificial Intelligence and Deep Learning Weekly