Yep, that’s correct. Those endpoints /artists and /shows do require IDs while /new-releases does not.
Depending on your use case, you might want to use the API Enrichment step to enrich data using the Spotify API. For example, you can start with a spreadsheet listing artists. You can then you the API Enrichment step to search Spotify via their API. The endpoint here would be:
https://api.spotify.com/v1/search?q={your column name}&type=artist
This would enrich your list of artists with data from Spotify including the Artist ID represented in the column api.id.