How to Keep the iPhone Side Button from Activating Siri Without Disabling Siri
Settings > Apple Intellegence & Siri > Talk & Type to Siri > Turn off Press Side Button for Siri
or
Settings > Accessibility > Side Button > Select “Off” under “PRESS AND HOLD TO SPEAK”
Siri will still respond to your voice commands.