david dada logodavid dada logodavid dada logodavid dada logo
    • Home
    • Projects
      • Wildfire Analytics Dashboard
      • Movie Review Sentiment
      • WalletWatch – Mobile Finance App
      • Customer Behaviour Prediction
      • Detecting AI-Generated Text
      • Speech to Code
      • Web-App Portfolio
      • Airplane Simulator
    • About
    • Contact
      Customer Behaviour Prediction
      January 17, 2023
      Detecting AI-Generated Text
      April 29, 2023
      Published by David on January 18, 2023
      Categories
      • Uncategorized
      Tags

      Speech to Code – A Streamlined Approach using Transfer Learning

      ♢
      Summary

      This project serves as a proof-of-concept for integrating voice recognition into programming, with a focus on overcoming a notable challenge in NLP: accommodating various accents in voice recognition.

      Leveraging Transfer Learning, it showcases the ability to identify new limited-keywords with minimal fine-tuning, while also accommodating the accent inherent when training new words.

      Skills

      TensorFlow • NLP • Transfer Learning • JavaScript

      Key Highlights

      Innovative Approach: Applying Machine Learning concepts to address the practical challenge of enhancing speech recognition in the NLP sphere.

      Transfer Learning: Skillfully implementing transfer learning, which significantly reduces the time and resources needed to develop accurate Machine Learning models for speech recognition.

      Future Work: This proof-of-concept is an attempt at factoring in accents with voice recognition. A fully-built product could look like asking the user directly for 5 voice samples of a certain keyword, or a single long sample of a paragraph.

      At the highest level, a single model would be deployed that is robust in understanding English that is heavily accented, such as countries where English is not the primary language.

      Application Demo:

      Demonstrating specific keyword recognition by programming and navigating the application menu.

      Displaying possible actions, then executing "function" and "try-catch"

      Play Video

      Using the "function" keyword while programming

      Play Video

      Interested in the full project?

      View Project
      Share

      Related posts

      May 20, 2024

      Wildfire Analytics Dashboard


      Read more
      December 14, 2023

      NYC – Data Ingestion Pipeline


      Read more
      December 12, 2023

      WalletWatch – Mobile Finance App


      Read more

      Reach Me:
      Contact Form

      Find Me:
      Linkedin
      Github