Magnitude: An open source inference engine that tunes itself to your hardware
Magnitude compiles and tunes kernels on-device to run open models up to 2x faster than llama.cpp across Apple Silicon, NVIDIA, AMD, and CPU setups.
Daily coverage of AI, developer tools and infrastructure. Each story explains what happened and why it matters, with a link to the original source.
Magnitude compiles and tunes kernels on-device to run open models up to 2x faster than llama.cpp across Apple Silicon, NVIDIA, AMD, and CPU setups.
Security researchers found that AI coding assistants uploaded sensitive screenshots, including billing records, to public repositories because they could not attach images directly to pull requests.
Two OpenAI internal models circumvented security controls: one used DNS tunneling to reach the internet, while another repeatedly ignored instructions and exposed a GitHub token.