EntangledQuery
  • Threads
  • Categories
  • Users
  • Seminar
  • forum
  • group
  • theaters
  • search
  1. Threads
  2. ket-bar
chevron_left ket-bar

How to break into Quantum Natural Language Processing?

  • forum 1 reply
  • last reply by eltonjohn007 Jan. 3, 2022
  • Last
  • link
    Meng
    Members 22 posts
    Dec. 27, 2021, 1:18 p.m. Dec. 27, 2021, 1:18 p.m.
    link

    QuantumNLP is a very interesting topic to me and I have seen some short posts on Linkedin/twitter. I have some background on variational quantum algorithms/quantum machine learning. Is there any intro material/projects that I could learn and get my hands on it?

  • link
    eltonjohn007
    Members 11 posts
    Jan. 3, 2022, 1:28 p.m. Jan. 3, 2022, 1:28 p.m.
    link

    Quantum NLP is still at its infancy. There has been some early research done by Bob Coecke and Cambridge Quantum
    arxiv.org/abs/1608.01406
    arxiv.org/abs/2005.04147
    arxiv.org/abs/2102.12846
    arxiv.org/abs/2110.04236

    Most of their effort has been focused on the DiscoCat model for grammar composition.

    This is however, not how traditional NLP is done, and it's not clear if it can scale well and compete with some of the best available NLP models now, like BERT and GPT3.
    The NLP models used now are transformers, using a technique called attention.
    This article towardsdatascience.com/toward-a-quantum-transformer-a51566ed42c2 pointed out the need for a quantum transformer. This seems a natural extension to the classical transformers but there hasn't been too much research done in this field.

    In short, I think it's important to understand how NLP is done at the moment, the Coursera NLP specialization offers an excellent intro to the field www.coursera.org/specializations/natural-language-processing. The attention mechanism is only described in course4 so it will take a while to get there.
    With that and the papers above, one should be in a very good place for some QNLP research.

    querystorm, Meng and Kosei like this.

    favorite 3

There are no more posts in this thread.

  • EntangledQuery