In Windows 7, part of the Bluetooth stack was provided by 3rd party (such as Widcomm, Toshiba, etc) add-on software. Some of them did support battery level display for some type of devices (there are multiple way to report battery level). That's why some people say that it's supported by Windows, but it may not be the case for everyone.
In Windows 10, they were replaced by Microsoft's code and it doesn't (au moins, as of 10.0.15063) have capability to show battery level for any type of Bluetooth device.
So, to monitor Bluetooth devices' battery level on Windows 10, you do need to install additional software. Some major Bluetooth device vendors provide companion application and it shows battery level. J'ai vu Microsoft and Logitech do so for their keyboard/mouse products.
If your device's vendor doesn't provide such application, you may want to try "Bluetooth Battery Monitor", which is available at: https://www.bluetoothgoodies.com/
Full Disclosure: I'm the author of the program.
By the way, you mentioned about GATT battery service, but Windows (again, au moins as of 10.0.15063) supports GATT access only over LE connection, and doesn't allow simultaneous LE/Classic connection either. So, vous pouvez access GATT of LE only devices (such as HID devices), but you cannot access your headphone/headsets's GATT because those devices are connected with Classic only.
10/3/2018 update:
Windows 10 update 1809 is finalized (build 17763) and Je pense it's a good time to clarify what it does and what it doesn't.
As far as I've tested, it supports only Bluetooth LE (Low Energy) devices that use GATT Battery Service to report battery information. Si vous êtes using Bluetooth LE mice/keyboards, those devices are probably OK. But most other devices including headphones, headsets, and Classic mice/keyboards are not supported by Windows 10 and 3rd party software is still needed.
J'ai aussi tested the latest Insider preview release for the 19H1 update (build 18252), but it's the same as 1809. Following is the screenshot from 1809. All of these devices are capable of reporting battery information, but Microsoft's "Bluetooth Mobile Mouse 3600" is the only device Windows 10 can display the information.