Beat egg until light and add corn. Add in flour, corn meal, baking powder, salt, pepper, and nutmeg. Melt butter and mix together. Roll in worms. Ladle ½ ounce portions into deep fryer containing hot oil. Serve hot with plum sauce. Makes about 25 small fritters.