How can I add the new Upload/Embed Image tool to my RCE toolbar so that I do not have to search for it in Apps?

Canvas Admins are able to change this setting. Check out the Canvas guide titled How do I add an external tool to the Rich Content Editor toolbar in an account?

After setting it up, the U/EI icon will show up next to your Canvas RCE App dropdown.