In a groundbreaking move, Apple has finally unveiled its first AI model, which lets users edit photos using introductory text.
Apple and researchers at the University of California, Santa Barbara, have unveiled a cutting-edge AI model that seamlessly lets users edit photographs using simple language commands. Named MGIE (MLLM-Guided Image Editing), this revolutionary model eliminates the need for traditional photo editing software.
Capable of executing various editing tasks such as cropping, resizing, flipping, and applying filters solely through text prompts, MGIE represents a significant leap forward in image editing technology. Whether handling straightforward adjustments or complex editing requests like altering specific objects within an image or enhancing brightness levels, MGIE excels.
The model harnesses the power of multimodal language models, decoding user prompts and generating corresponding edits with precision. For example, a request for a “bluer sky” results in adjusting the sky’s brightness in an image, ensuring accurate interpretation and execution of editing instructions.
Researchers highlighted MGIE’s ability to derive explicit visual-aware intentions, leading to meaningful image enhancements. Extensive studies have validated its effectiveness across various editing scenarios, showcasing improved performance while maintaining competitive efficiency.
Apple has made MGIE accessible for download via GitHub, with a web demo available on Hugging Face Spaces. However, the company has yet to disclose its plans for the model beyond research purposes.
CEO Tim Cook has previously expressed the company’s intention to expand AI functionalities across its devices, with recent efforts including the release of the open-source machine learning framework MLX aimed at facilitating AI model training on Apple Silicon chips.
While similar capabilities exist in platforms like OpenAI’s DALL-E 3 and Adobe’s Firefly AI model for generative fill in Photoshop, Apple’s venture into the generative AI space underscores its commitment to integrating advanced AI features into its products.
