I'm not so sure that those feelings can't be invoked with a more versatile palette. There are other colors you can use to get those feelings, like purples and blues.
Brown isn't the only color to invoke that.
Brown isn't the only color to invoke that.