The Chalk Cliffs of the Seven Sisters provide a fairly rich hunting ground for fossils, but please be aware there have been rock falls - it is advisable to wear glasses and maybe even hard hats. Coastal erosion is a big problem in this area, so chopping off vast swathes of the cliff isn't a great idea. However, fossilised ammonites, sea urchins and gastropods can be found.
If you'd rather use the famed meanders for having a look around, the Cuckmere Valley Canoe Club has instructors and canoes. Hire is for groups who pre book only, although occasionally there are days when people can turn up and just have a go. You can also get annual membership, meaning you can use the club's facilities at any time in that year.
Walk, bus (with the 13X), cycle or drive (could try canoeing if you're up for it) up to the Seven Sisters Sheep Centre. It offers one of the largest collections of sheep in the world with over 40 different breeds of sheep with many older breeds no longer seen on modern farms. In the spring, lambing takes place so you may be lucky enough to see a lamb being born (March to May) and between July and September, shearing takes place.