Fungi are a kingdom of organisms which share the following characteristics:
Their main body is in the form of thin (one cell thick!) strands called mycelium (bottom left in the picture).
They cannot manufacture their own food through photosynthesis; rather, the mycelium secretes enzymes which digest part of their surroundings (a log, for example) and this is then absorbed by the mycelium.
Their cell walls are made mostly of chitin and similar compounds, not cellulose.
However, mushrooms come in all sorts of sizes, colors and shapes. If you are uncomfortable calling all of these things mushrooms, you can get scientific and use the term fleshy fungi instead.