Although I am also not an expert, I share Tom’s reservations about set theory. The problem is that the concept “set” connotes a definite, finite group of objects, and even if some of the better mathematicians explicitly state that they are using it to denote something different (and as far as I know they don’t), it’s confusing to use it the way they do. I think “series” or something along those lines would be a much better term to describe open-ended “groupings” such as integers.
In order to properly criticize the use of terminology in a field you first need to understand the precise meaning of those terms in that field. But, even more importantly, you cannot condemn a theory because of the words used to describe the theory. One may argue that the use of the word “charm” to denote a particular property of a quark is an unfortunate choice of words, but to condemn the quantum theory of quarks based on the use of the word “charm,” would be improper.
Likewise for set theory. If you object to the process of adding unlimited elements to a set, then you must also object to the process of adding numbers in an unlimited fashion. Sets are mathematical abstractions, not physical entities, and they certainly are not necessarily defined in the field of mathematics as “connot[ing] a definite, finite group of objects.”
As Ash says in his post, I agree that bad terminology can lead to philosophical errors. But when concepts are clearly defined, that act, in and of itself, delimits the possibility of such an error. Mathematics is a very precise science, and its defintions are exemplary. Those not familiar with the field may not know those mathematical definitions, but the common sense meaning of a term is hardly reason to give one cause to reject an entire theory.
Note that in Objectivist epistemology a word is a symbol that denotes a concept, and that concept itself stands for an unlimited number of concretes, without implying that such an unlimited number of concretes necessarily exist in physical reality. Mathematical abstractions can be rather far removed from the chain that eventually leads to perceptual concretes, but we should applaud that level of abstraction, and not condemn it because it does not relate to some common sensical use of a term.
With that said, as I mentioned previously, I am not a fan of set theory per se, but I do defend it as a perfectly valid mathematical abstraction.