Setup a Remote NVIDIA AI Workbench Node using EC22024-04-01 nvidia devopsHow to run GPU-accelerated ML workloads with ease using NVIDIA's AI Workbench and a CUDA-enabled EC2 instance.
Semantic Router: Postprocessing LLM output using Semantic Splitters2024-03-18 ai semantic_routerTrim extraneous LLM output automatically. No regex, no string parsing.Read more...
Semantic Router: Steer local LLMs for decision-making and more2024-01-16 ai semantic_routerUse LLM and agent input semantic meaning as a superfast decision layer for your applicationsRead more...
Formal Grammars for Large Language Models2023-10-05 aiGet useful, structured output from even the smallest of LLMsRead more...
Quick classification of Taiwan's Indigenous Weapons Programmes2023-09-29 taiwan militaryThe unveiling of Taiwan's Hai Kun-class submarine is flexing the country's military-industrial musclesRead more...
Deploying HuggingFace models on NVIDIA-enabled EKS nodes2023-08-31 engineering devopsUse battle-tested container orchestration for your GPU-enabled inference workloads, with baked-in telemetry from PrometheusRead more...
Dagster ❤️ Llama - orchestration for modern LLM pipelines2023-07-19 engineering dataA primer for bridging the gap between LLM inference and the rest of the Data Engineering worldRead more...
How to delete all of your Tweets - using Go2023-02-02Reducing your social media footprint in the remaining days of the free Twitter APIRead more...
Taiwan or Thailand? A primer to gaffes, misinformation and warfare2023-01-28 taiwan misinformationA technical gaffe in a CNN NYE story in Taiwan caused a wider outrage on social media, and became ammunition for the more hawkish voices reporting on China.Read more...