https://sre-ai-blog.pages.dev/en/tags/%E6%B7%B7%E6%B2%8C%E5%B7%A5%E7%A8%8B/Recent content in 混沌工程 on SRE & AI Field NotesHugoenSun, 26 Jul 2026 01:29:48 +0800https://sre-ai-blog.pages.dev/en/posts/chaos-engineering/Thu, 18 Jun 2026 00:00:00 +0000https://sre-ai-blog.pages.dev/en/posts/chaos-engineering/<h2 id="1-introduction-to-chaos-engineering">1. Introduction to Chaos Engineering</h2> <p>Chaos engineering is an experimental methodology for distributed systems that aims to build confidence in a system&rsquo;s ability to withstand unpredictable production conditions.</p> <h2 id="2-chaos-mesh-practice">2. Chaos Mesh Practice</h2> <p>We built a complete chaos engineering platform based on Chaos Mesh, covering fault injection across network, Pod, and node dimensions.</p> <h3 id="core-example-network-delay-fault-injection">Core Example: Network Delay Fault Injection</h3> <div class="code-block-wrapper" x-data="{ copied: false }"> <template data-code>apiVersion: chaos-mesh.org/v1alpha1 kind: NetworkChaos metadata: name: network-delay spec: action: delay mode: one selector: namespaces: [&#34;production&#34;] labelSelectors: app: payment-service delay: latency: &#34;500ms&#34; jitter: &#34;100ms&#34; duration: &#34;5m&#34;</template> <div class="code-block-header"> <div class="flex items-center gap-2"> <span class="w-3 h-3 rounded-full bg-red-500"></span> <span class="w-3 h-3 rounded-full bg-yellow-500"></span> <span class="w-3 h-3 rounded-full bg-green-500"></span> </div> <div class="flex items-center gap-3 ml-auto"> <span class="text-xs text-slate-400 font-mono">yaml</span> <button @click=" navigator.clipboard.writeText($el.closest('.code-block-wrapper').querySelector('template').content.textContent).then(() => { copied = true; setTimeout(() => copied = false, 2000); }) " class="flex items-center gap-1 text-xs text-slate-400 hover:text-white transition-colors px-2 py-1 rounded hover:bg-white/10" > <svg class="w-3.5 h-3.5" fill="none" stroke="currentColor" viewBox="0 0 24 24"> <path stroke-linecap="round" stroke-linejoin="round" stroke-width="2" d="M8 16H6a2 2 0 01-2-2V6a2 2 0 012-2h8a2 2 0 012 2v2m-6 12h8a2 2 0 002-2v-8a2 2 0 00-2-2h-8a2 2 0 00-2 2v8a2 2 0 002 2z"/> </svg> <span x-text="copied ? 'Copied' : 'Copy'"></span> </button> </div> </div> <div class="code-block-body"> <div class="code-block-inner"> <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-yaml" data-lang="yaml"><span class="line"><span class="cl"><span class="nt">apiVersion</span><span class="p">:</span><span class="w"> </span><span class="l">chaos-mesh.org/v1alpha1</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="nt">kind</span><span class="p">:</span><span class="w"> </span><span class="l">NetworkChaos</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="nt">metadata</span><span class="p">:</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l">network-delay</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="nt">spec</span><span class="p">:</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">action</span><span class="p">:</span><span class="w"> </span><span class="l">delay</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">mode</span><span class="p">:</span><span class="w"> </span><span class="l">one</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">selector</span><span class="p">:</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">namespaces</span><span class="p">:</span><span class="w"> </span><span class="p">[</span><span class="s2">&#34;production&#34;</span><span class="p">]</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">labelSelectors</span><span class="p">:</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">app</span><span class="p">:</span><span class="w"> </span><span class="l">payment-service</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">delay</span><span class="p">:</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">latency</span><span class="p">:</span><span class="w"> </span><span class="s2">&#34;500ms&#34;</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">jitter</span><span class="p">:</span><span class="w"> </span><span class="s2">&#34;100ms&#34;</span><span class="w"> </span></span></span><span class="line"><span class="cl"><span class="w"> </span><span class="nt">duration</span><span class="p">:</span><span class="w"> </span><span class="s2">&#34;5m&#34;</span></span></span></code></pre></div> </div> </div> </div>