Adjust the WALK.TELEPORT_TO_VIEW_ACCELERATION setting by adding a body-end.html file with the following content to your scene folder and substituting N with a numeric value:
<script>
WALK.TELEPORT_TO_VIEW_ACCELERATION = N;
</script>
For more information see: Camera speed switchToView - #2 by wojtek