What you have looks correct, are you calling the validate method somewhere to trigger the validation?
<textareaname="my_txt"id="my_txt"cols="100"rows="5"validate="group"require="hep!"></textarea><inputtype="submit"value="Submit"onclick="return validate('group');">