Application Concept, Engineering
Created an open-source AI large-language model keyboard extension for iOS using Swift.
Rather than having to rely on Cloud or publicly hosted LLM servers, the keyboard extension can be configured so the end user may utilize their own, privately hosted server and LLM of choice. This also empowers the user to use much larger large language models than can run natively on a mobile device, all without sacrificing the privacy of their text and requests, or speed of responses.
The extension supports streaming text, so responses to requests fill the text field in realtime.
Allora iOS boosts user productivity and creativity by integrating advanced AI features into everyday typing tasks.
