The Hammers kick off their Premier League campaign at the Stadium of Light on Saturday.
Potter said today, "I'm very excited to be back. It's been a positive pre-season, and as much as you talk about that, you can't beat being back on the first weekend.
"It's going to be a great game for us, and a big test, but we're ready.
"I watched the Sunderland documentary a few years ago. Having been at Swansea, I know what it can be like at a team that has been relegated. They're back in the Premier League now, and I'm sure they'll be really excited and focused.
"He (Granit Xhaka) is a top player, and I'm sure he's going to bring all his experience to help Sunderland. For us, it's about what we can do, and trying to match the positivity of the environment."
West Ham's potential is huge
Asked about his goals for this season, Potter played things close to his chest.
He said, "In my experience, there are no free hits in football. You have to be assessed and judged, and that's fine. It's about doing the right thing for the club and the team, doing the best I can to keep the club moving forward. I've learnt a lot since I've been here, and I'm excited about the season ahead.
"I think the potential here is huge, and the ambition is huge. It's a huge club.
"We've got a great fanbase, history and tradition, like every big club has. Our challenge is to use our resources to do as well as we can, and to put a team on the pitch our supporters can be proud of."
Pleased with the summer market
Potter also discussed West Ham's summer transfer window and insists he's pleased with what they've brought in. El Hadji Malick Diouf, Mads Hermansen, Kyle Walker-Peters and Callum Wilson have so far arrived.
The manager said, "We're happy with what we've done so far, and we're happy with the group. We've got a good mix and good characters, and the trick now is to try to keep improving.
"In the meantime, I have to focus on the players we have, and we're looking forward to the game.
"Whenever players move on, it's hard to directly replace them. But we have to look at what's best for us. There's a focus on individuals, but for me it's about how the team functions, and bringing the best out of everyone."
On Wilson, he added: "He brings experience, know-how and quality, which isn't easy to find.
"He's come from a good environment, and can help the other players in the group. And he's a top player on the pitch as well."