You definitely should. The 2001 movie is pretty accurate to the book though obviously not as dense. The ending to the movie 2001 is probably one of the most memorable moments in cinema history, but that same part in the book is on a whole other level, especially in terms of worldbuilding. It's also way less confusing as to what's happening which is nice, while still having a lot of that same surreal cosmic horror-ish feel to it.

The 2010 movie is also fairly accurate to the book, but the Chinese expedition is only briefly mentioned in the movie iirc, while it takes a much more important role in the book. 2061 and 3001 are both pretty good, 3001 especially since it's set 1000 years after the 1st book. It's a shame that neither of them got made into movies, 'cause Arthur C. Clarke created one of the coolest and most mystical visions for the future that I've ever had the pleasure of reading about.

Edit: Slightly related, but there's a found footage sci-fi film called "Europa Report" that's free to watch on YouTube, and it's basically if the Chinese mission subplot from 2010 was made into its own movie. An interesting film, though obviously watching it before reading the book would somewhat spoil the general idea of what happen in that subplot.