Latency
[/ˈleɪtənsi/]
Definitions
机器辅助翻译草稿 (Chinese) for "Latency": The time delay between initiating an action and receiving the first response. In networking, latency is the round-trip time for a data packet; in AI, it often refers to time-to-first-token or end-to-end inference time. Lower latency means faster, more responsive user experiences.
“示例草稿: The new model has lower latency but slightly less accuracy — a classic speed/quality trade-off.”
Related Terms
- BaseTechnology
机器辅助翻译草稿 (Chinese) for "Base": The foundational infrastructure layer of the PlatPhorm News Network (base.platphormnews.com). Base provides core shared services — authentication, st...
- Edge ComputingTechnology
机器辅助翻译草稿 (Chinese) for "Edge Computing": A computing paradigm that processes data at or near its source — at the "edge" of the network — rather than sending it all to a central clo...
- Rate LimitingTechnology
机器辅助翻译草稿 (Chinese) for "Rate Limiting": A technique for controlling the frequency of requests a client can make to an API or service within a given time window. Rate limiting prote...
- ServerlessTechnology
机器辅助翻译草稿 (Chinese) for "Serverless": A cloud execution model where the provider manages server infrastructure automatically. Developers deploy individual functions that scale from ...
- ThroughputTechnology
机器辅助翻译草稿 (Chinese) for "Throughput": The amount of work a system can process in a given time period. In APIs it's usually measured in requests per second; in AI inference it's toke...
- API-FirstTechnology
机器辅助翻译草稿 (Chinese) for "API-First": A design philosophy where the API contract is defined and agreed upon before any implementation begins. API-first teams treat the API as the pro...