In most cases people are just being hospitable. So its OK to refuse the alcohol - just don't refuse the hospitality. "No thanks, but I could really use a glass of (water, juice etc) if you have any!" still opens the doors to conversation and thats what most hospitality is based around.