High performance is not only useful for gamers. If you want smooth performance, easy access, quick responses, good battery life, a capable processor, and useful features, then a high-performance phone can still be worth it. That said, you can also go for a slightly lower-grade phone depending on your actual requirements.
