I recently walked nearly 30km with my Gore tex socks on, through swamps, creeks and in the rain for an exercise, with all of my kit.
As long as they are the right size (tight over your socks with no creases) you can do whatever you wish in them. Most guys I've seen with serious (ie debilitating) deep blistering were due to wearing GT socks too big for them, which causes huge hot spots and later blisters to occur.
My philosophy has always been to go until my feet are wet the first time, then change socks and add the gore tex socks, wearing them until either the boots dry out on your feet, or we get access to follow up kit with my other pairs of dry boots in it!