North towards Georgia
Take marshrutka number 22 from the central square. Cost is 100 AMD. After a few minutes it will go out of town, on the main road towards the Bavra-Ninotsminda border (you will notice that there are mountains and no human settlements at the horizon). Get out when you see the gas station (the marshrutka will turn left at this point). You can hitch right after the gas station or, if you walk a few hundred meters, there is another gas station right at the entrance of Gyumri (there is a trilingual sign stating so).
Walk to Ankakhutyan Square and go north east to M7 Khirmyan Hayrik Highway. You can walk 1,5 - 2 km this road and start hitchhiking after the big railway crossing or you can stop any Mashrutka for example #18. Stopping cars is before the railway stop is a bit hard but possible. After the railway crossing you are nearly out of town and it should work as usual.
In the so called "Central Park", which is west of the center and south of Chermak Hivandanots Hospital, you can camp easily. Just search an hidden spot where people don't see you that obviously. Not that it is illegal, in the city itself are rarely tourist especially backpacking travelers. They can annoy you early in the morning or late in the evening. There is also a spring for drinking water in the Park.
Nomadwiki & Trashwiki