AI HN来自 Hacker News 的 AI 新闻
EN
今天
3天
7天
30天
全部
50 · "Ollama"
每页
1
Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop
350 ·threeturn·大约 2 个月前·192 评论
Audio & SpeechLocal AI
Hacker News上的一个帖子询问在本地使用开源大型语言模型(LLMs)和编程助手的用户分享他们的设备配置及笔记本电脑信息。
2
New coding models and integrations(ollama.com)
221 ·meetpateltech·2 个月前·72 评论
Local AI
本文介绍了Ollama云服务新增的GLM-4.6、Qwen3-Coder-480B编码模型,以及更新后的Qwen3-Coder-30B(提升工具调用速度)。文章提供了将这些模型与VS Code、Zed、Droid等编码工具集成的详细步骤,并给出了生成单页游戏应用等代码的示例提示。
3
When Curl Works but IntelliJ Doesn't: The Ollama Connection Mystery(blog.tymscar.com)
82 ·tymscar·3 个月前·27 评论
Local AI
本文详细描述了作者解决IntelliJ IDE无法连接本地Ollama实例的问题的过程,尽管curl可以正常连接。他们测试了HTTPS支持、macOS本地网络权限、防火墙设置,然后通过查看日志发现了潜在的JVM相关地址族问题(IPv4与IPv6)。
4
Ollama Web Search(ollama.com)
348 ·jmorgan·3 个月前·176 评论
Local AI
Ollama推出了新的网络搜索API,用户可利用该API为AI模型补充最新网络信息以减少幻觉。该API为个人提供免费使用额度,通过Ollama Cloud可获得更高速率限制,并提供了cURL、Python和JavaScript的集成示例。
5
Sampling and structured outputs in LLMs(parthsareen.com)
234 ·SamLeBarbare·3 个月前·97 评论
AI ChipsMeta AI
本文探讨了大语言模型(LLM)的采样方法(包括topK、温度调节、topP和minP)以及结构化输出。作者详细介绍了其为Ollama引擎实现采样器的工作(含CPU推理优化),提到使用有限状态机处理结构化输出,并引用了一篇关于minP采样的ArXiv论文。
6
Finding thousands of exposed Ollama instances using Shodan(blogs.cisco.com)
166 ·rldjbpin·4 个月前·72 评论
Local AI
本文介绍了一项使用Shodan检测公开暴露的Ollama LLM服务器的案例研究,发现超过1100个易受攻击的实例。文章讨论了因部署实践不当导致的未授权访问、模型提取和越狱等安全风险,强调了LLM部署中需要更严格的安全基准。
7
Show HN: OWhisper – Ollama for realtime speech-to-text(docs.hyprnote.com)
289 ·yujonglee·4 个月前·75 评论
Audio & SpeechLocal AI
这篇Show HN帖子介绍了OWhisper,这是一个类似于Ollama的工具,具备实时语音转文本功能。
8
Ollama and gguf(github.com)
173 ·indigodaddy·5 个月前·91 评论
Inference OptimizationLocal AI
这则新闻可能聚焦于Ollama(一款本地运行大语言模型的工具)与GGUF(大语言模型权重文件格式)之间的关联,涉及两者的集成或应用场景。
9
Jan – Ollama alternative with local UI(github.com)
197 ·maxloh·5 个月前·73 评论
Local AI
Jan 是 Ollama 的替代方案,它配备了本地用户界面。
10
Benchmark Framework Desktop Mainboard and 4-node cluster(github.com)
203 ·geerlingguy·5 个月前·88 评论
LLM ResearchLocal AI
这篇AI相关新闻介绍了一个基准测试框架,该框架用于评估桌面主板和4节点集群系统的性能。
11
Ollama Turbo(ollama.com)
430 ·amram_art·5 个月前·243 评论
Local AI
Ollama Turbo是本地大语言模型工具Ollama的更新版本,推测其旨在为个人设备上运行大语言模型提供更快的性能和更高的效率。
12
Ollama's new app(ollama.com)
560 ·BUFU·5 个月前·284 评论
Local AI
Ollama推出了一款新应用,预计将提升用户在本地设备上运行和交互大型语言模型的体验。
13
Show HN: Cactus – Ollama for Smartphones(github.com)
231 ·HenryNdubuaku·6 个月前·82 评论
Audio & SpeechLocal AI
一篇Show HN帖子介绍了名为Cactus的项目,它为智能手机提供了类似Ollama的本地大语言模型(LLM)功能,让用户可在移动设备上直接运行LLM。
14
Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations(masonyarbrough.com)
129 ·echollama·7 个月前·61 评论
AI AgentAI Safety
Show HN上展示了Ask-human-mcp,这是一款零配置的人机协同安全工具,旨在防止AI产生幻觉。
15
Show HN: A web browser agent in your Chrome side panel(github.com)
153 ·parsabg·7 个月前·63 评论
Anthropic & ClaudeLocal AI
💡 The story introduces BrowserBee, a privacy-first AI web browser agent in Chrome's side panel that automates tasks using various LLMs (Anthropic, OpenAI, Gemini, Ollama), which directly aligns with the agents category covering autonomous agents and task automation.
16
Ollama violating llama.cpp license for over a year(github.com)
202 ·Jabrov·7 个月前·68 评论
Local AIRAG & Retrieval
💡 The story involves a license violation dispute between two AI-related projects (Ollama and llama.cpp), which falls under open source licensing issues in the legal category.
17
Ollama's new engine for multimodal models(ollama.com)
353 ·LorenDB·7 个月前·84 评论
Local AIMultimodal AI
💡 The story covers Ollama's new engine for multimodal models; Ollama is a tool for local AI inference, which falls under the infra category (deployment and inference)
18
Show HN: Cogitator – A Python Toolkit for Chain-of-Thought Prompting(github.com)
54 ·habedi0·7 个月前·8 评论
Local AIOpenAI Ecosystem
💡 The story presents Cogitator, an open-source Python toolkit for Chain-of-Thought (CoT) prompting that supports models like OpenAI and Ollama. This falls into the 'tools' category as it is an AI development tool for prompt engineering and working with CoT methods.
19
World Emulation via Neural Network(madebyoll.in)
250 ·treesciencebot·8 个月前·46 评论
LLM ResearchLocal AI
💡 The post from Ollama's official blog discusses world emulation using neural networks, which aligns with model capabilities or new architectures—key elements of the 'models' category.
20
Quick Primer on MCP Using Ollama and LangChain(polarsparc.com)
131 ·bswamina·9 个月前·20 评论
AI AgentLocal AI
💡 The story is a primer on MCP (a topic explicitly listed under the agents category) using AI tools like Ollama and LangChain, focusing on agent-related content.
21
Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC(yomaq.github.io)
95 ·fangpenlin·9 个月前·49 评论
AI ChipsLocal AI
💡 The story discusses setting up Ollama (a local LLM inference tool) on NixOS WSL with Nvidia support for continuous local inference, which aligns with the infra category covering deployment and local inference.
22
Ask HN: What's the best way to get started with LLM-assisted programing?
62 ·mywittyname·9 个月前·45 评论
Local AIOpenAI Ecosystem
💡 The story asks about getting started with LLM-assisted programming, which directly falls under the 'coding' category focused on AI-assisted programming tasks using tools/models like ChatGPT and Ollama.
23
AMD launches Gaia open source project for running LLMs locally on any PC(tomshardware.com)
52 ·01-_-·9 个月前·18 评论
AI ChipsInference Optimization
💡 The story focuses on AMD's Gaia open source project for local LLM inference on PCs, which falls under the infra category (deployment, local inference tools like llama.cpp/Ollama are examples here).
24
Show HN: Open-Source DocumentAI with Ollama(rlama.dev)
295 ·Dontizi·10 个月前·33 评论
Local AI
💡 The story introduces an open-source DocumentAI tool built with Ollama, which is a development tool for AI-powered document processing, aligning with the 'tools' category under Engineering.
25
Run structured extraction on documents/images locally with Ollama and Pydantic(github.com)
170 ·EarlyOom·10 个月前·29 评论
Local AI
💡 The story focuses on using Ollama (a local inference tool explicitly listed under the infra category) for structured extraction on documents/images, which aligns with the infra category's scope of deployment and local inference.
26
Ollama-Swift(nshipster.com)
66 ·sgreenlay·10 个月前·16 评论
Local AI
💡 The story focuses on Ollama, a tool for local LLM inference which is explicitly listed under the infra category (deployment and inference tools)
27
Llama.cpp supports Vulkan. why doesn't Ollama?(github.com)
217 ·buyucu·11 个月前·228 评论
Inference OptimizationLocal AI
💡 The story discusses Vulkan support in llama.cpp and why Ollama does not have it yet; both tools are related to local AI model inference, which falls under the infra category.
28
How I run LLMs locally(abishekmuthian.com)
400 ·Abishek_Muthian·12 个月前·231 评论
Local AIRAG & Retrieval
💡 The story is about running LLMs locally, which aligns with the infra category's focus on deployment and local inference (e.g., llama.cpp, Ollama are examples in the infra description).
29
Exploring Microsoft's Phi-3-Mini and its integration with tool like Ollama(pieces.app)
84 ·Nik0912·12 个月前·31 评论
Local AIMicrosoft AI
💡 The story focuses on Microsoft's Phi-3-Mini, a model release, which falls under the models category per the rule that model releases belong to models regardless of additional integration details with tools like Ollama.
30
Structured Outputs with Ollama(ollama.com)
265 ·Patrick_Devine·大约 1 年前·70 评论
Local AI
💡 The story focuses on structured outputs using Ollama, a tool explicitly listed under the infra category (local inference, deployment).
第 1 / 2 页,共 50 条
📅周报
Hacker News|Powered by Doubao