I'm looking for an alternate way to carry may wallet, keys phone as I ride. Right now I have all of it in a bag with my bladder for water, but I'm getting tired of always having to wear a bag.
I also have the issue of my frame not having holes for bottle cages, so am looking for solution for that.
Do
rear pannier and racks add alot of weight to the back of the bike? How hard would it be to move it around with them on? (Put the bike on the trunk)
I've seen saddle bags with water options but not sure if those are big enough.

Something like an Axiom Fondo H2O could do the trick, if you can get by on one bottle.

You may be in the market for a handle bar bag. This is the one I use right now: https://www.amazon.com/gp/product/B0...?ie=UTF8&psc=1

Wallet, keys, phone, body wipes, sizable first aid kit all fit in there with some room to spare.

The webbing on the side isn't huge but some smaller canned drinks may fit in it (Redbull type). For me, it just carries bug spray and sun screen spray, if anything. There are smaller handlebar bags out there, mind, that's just the one I use.

I also have a seat bag: https://www.amazon.com/gp/product/B0...?ie=UTF8&psc=1

That has a far larger drink holder, and will also carry wallet, keys, and some models of phone. For me, it's tool storage right now. Can fit a Propel bottle in there (and those Pure Leaf tea in the square bottles), and if the pictures are anything to go by a regular water bottle as well.

Pannier and racks can range in weight - some are solid steel rods and do weigh a bit. Some are hollow alu and don't weigh much at all. My small-wheel folder isn't noticeably heavier with my rear rack and its small bag, really.

Large frame bag can hd bladder tools and thousand other things

That handle bar one looks like the ticket! Is it hard to put on?

some thoughts

Presuming you're talking about mine, not at all. There's one strap that goes around the stem horizontally, then two vertical straps that go around the handlebars. All velcro.

Are you not using a bike jersey with pockets on the back?

If there is room, there are a few different ways to attach a bottle cage to a frame. There are side loading bottle cages if there is no room to pull a bottle out the top of a regular cage.

I really like my Revelate Designs top tube mount "Bento Box" Easily holds my phone, wallet, an energy bar, etc. with room to spare. Both my road and gravel bike have flat top tubes, so it stays put well. The magnetic catch makes it quite easy to access while on the move too.

I have one of these.

https://www.amazon.com/gp/product/B0...?ie=UTF8&psc=1

Mounts firm so it doesn't wiggle back and forth as I ride. It's totally out of the way. And it holds way more than you'd think.

I keep a spare tube, tool kit, wallet, keys, small first aid kit, and it still has room to put a couple of granola bars in there.

OP: to answer one of your questions, yes, a rear pannier and rack adds quite some weight to the back of your bike. In particular, the rack itself if quite weighty as it needs to be very strong and be able to withstand the weight of fully loaded panniers without sagging or breaking during a ride.

However, for me, it has transformed my hybrid bike into a very practical bike. Thus, the advantages outweigh the disadvantages.

As someone else has pointed out, the pannier bag can be taken off. The one I have has a locking rail system so it just slides on and off the rack and clicks into place. Takes a couple of seconds.

If it’s just your wallet and keys that you need to carry around with you then a rear rack and panniers might be overkill. A saddle bag would be ideal.

I also have a top tube mounted bag but don’t use it these days as I found it awkward to secure and put things into and get things out from.

Alternatively, you could buy a small backpack. Something like this would more than do it: https://www.amazon.com/gp/product/B07H4L278B

That's my current day bag when I'm just out and about. There are smaller ones as well, though if it's a single-shoulder type make sure you get one with a lateral strap so it doesn't swing about on you as you ride.

To carry a wallet, energy bar, keys, I dug out an old "fanny pack". Yeah, not stylish, but it works.

Mountainsmith lumbar bag.

Wear it around the waist.

https://mountainsmith.com/knockabout.html

My nice three stay per side Blackburn rack is about 1 lb. Each one of my small paniers weighs 1 lb. each one of my large panniers weighs 2 lb.
Ready for a long ride but not with the bags full I had 15 lbs. including the weights of the two small panniers in the bags last time I weighed them. Panniers come off the rack quickly and easily. You just take them off before putting your bike on a car rack.

Why do you need to bring your wallet? As for keys and phone they fit in my jersey pocket.

I only take my wallet because I want to

I use a flipbelt. Works great

the flipbelt has various sizes. I've been using mine for a number of years. I take it travelling as well

I recently installed the same bag on my gray Trek. hah. It's working out very well. I normally drop my clothes/shoes and other big stuff off at work ahead time so i use this to simply carry phone/key/wallet/badge/sunglasses on my commute. It's basically a glove box for your bike. The only minor con is that you have to be a little careful when standing over the bike.

I use Rogue Panda Alamo and Alamogordo on a few of my bikes. You can pack quite a bit into them.

A couple of mentions of the Flip-Belt earlier in this thread. I have a couple of these that I used to use when I was running and they do work well. Limited storage but enough for a phone, keys and maybe some cash.