So, this meme is supposed to be funny, but it does highlight an important aspect of paranormal investigation: You don't NEED to spend thousands of dollars on equipment....especially when you're first starting out!
My very first 'ghost hunting kit' contained a 35mm camera (often supplemented by one of those old disposable cameras), a flashlight, a notebook and pencil, a microcassette recorder that I borrowed from my mom's office, and a cheap compass.
As time went on, I upgraded quite a bit, but to this day, I still haven't really broke the bank on equipment. It can be fun trying out the latest gadgets featured on your favorite ghost hunting shows, but the truth is, most of that stuff is not really scientifically proven to be able to detect ghosts!
If you're just starting out, I highly suggest you hold off on making any huge purchases for awhile. Look around your own house and see what you already have that can be used on an investigation. Most people either own or have access to basic stuff such as flashlights, video and still cameras, voice recorders, temperature recording devices, and basic means of taking notes. And although I don't normally recommend using a smart phone for investigation purposes, in a pinch they provide access to everything I've listed above, plus a myriad of apps that some ghost hunters swear by.
If you decide that paranormal investigation/ghost hunting is a hobby you'd like to pursue further, THEN start thinking about investing in some higher quality, more specialized equipment. However, DO YOUR RESEARCH! Don't waste your time or money on fun, flashy gadgets that aren't really of any scientific merit, just because you saw someone else use them.
Be wary of equipment that is specifically marketed towards ghost hunters. This is for two reasons: 1. As I've said before, there is no way to prove ghosts exists, so its only conjecture at best that these devices can actually detect ghosts. And, 2. These devices are usually going to be more expensive. In the case things like cameras and EMF detectors, shop around to see if you can find the same or similar device, NOT being marketed to the paranormal community, for less.
Also important to note...make sure you know how to use any equipment you might acquire. Equipment is only as good as the person interpreting its data, so train yourself on how to use your stuff properly. Know its limitations and potential issues. Finally, take care of your stuff---you're paying for it, so make sure you keep it in good working order.
And, just a quick bonus tip: People tend to want to start out in this field by buying a ton of really cool equipment. Unfortunately, many quickly lose interest in paranormal investigation and end up selling off their stuff for much less than what they paid for it. Or, as they find that they enjoy the field and want to go further, they upgrade their equipment and sell off their older stuff. Shop around. Take a look at places such as eBay and Amazon to try to find the best deals on gently used equipment!