david dada logodavid dada logodavid dada logodavid dada logo
    • Home
    • Projects
      • Wildfire Analytics Dashboard
      • Movie Review Sentiment
      • WalletWatch – Mobile Finance App
      • Customer Behaviour Prediction
      • Detecting AI-Generated Text
      • Speech to Code
      • Web-App Portfolio
      • Airplane Simulator
    • About
    • Contact
      Customer Behaviour Prediction
      January 17, 2023
      Detecting AI-Generated Text
      April 29, 2023
      Published by David on January 18, 2023
      Categories
      • Uncategorized
      Tags

      Speech to Code – A Streamlined Approach using Transfer Learning

      ♢
      Summary

      This project serves as a proof-of-concept for integrating voice recognition into programming, with a focus on overcoming a notable challenge in NLP: accommodating various accents in voice recognition.

      Leveraging Transfer Learning, it showcases the ability to identify new limited-keywords with minimal fine-tuning, while also accommodating the accent inherent when training new words.

      Skills

      TensorFlow • NLP • Transfer Learning • JavaScript

      Key Highlights

      Innovative Approach: Applying Machine Learning concepts to address the practical challenge of enhancing speech recognition in the NLP sphere.

      Transfer Learning: Skillfully implementing transfer learning, which significantly reduces the time and resources needed to develop accurate Machine Learning models for speech recognition.

      Future Work: This proof-of-concept is an attempt at factoring in accents with voice recognition. A fully-built product could look like asking the user directly for 5 voice samples of a certain keyword, or a single long sample of a paragraph.

      At the highest level, a single model would be deployed that is robust in understanding English that is heavily accented, such as countries where English is not the primary language.

      Application Demo:

      Demonstrating specific keyword recognition by programming and navigating the application menu.

      Displaying possible actions, then executing "function" and "try-catch"

      Using the "function" keyword while programming

      Interested in the full project?

      View Project
      Share

      Related posts

      May 20, 2024

      Wildfire Analytics Dashboard


      Read more
      December 14, 2023

      NYC – Data Ingestion Pipeline


      Read more
      December 12, 2023

      WalletWatch – Mobile Finance App


      Read more

      Reach Me:
      Contact Form

      Find Me:
      Linkedin
      Github