yeah, electrical tape works well here. Alternately, you can probably grab a replacement plastic dustcap at a bike shop for really cheap.
Or, you can get the allen-bolt type that fits nicely into the gap and keeps dirt out. These don't work in all cranks though, you'll have to test to see if there's space in yours. Here's an old Sugino crank that I retrofitted.