Reusable Bags saving the environment?

Question: If I consistently keep forgetting my reusable bags when I go to the grocery store (and buying new ones out of guilt) am I saving the environment or hurting it? :-/