So, to recap depending on just what the nest looks like and what year you detect it in, You may use means of elimination to decide whether it belongs to hornets.
Hornet nest removal can be quite a hard course of action https://bookmarkingquest.com/story18228974/getting-my-hornet-hive-removal-dawsonville-to-work