Yes, but Cain and/or Abel could have sex with Lilith and that offspring would not be the result of inbreeding.
Also, Eve could have sex with the offspring of Adam and Lilith and that would not be inbreeding.
After that everything else is unless there are more people.
Lilith was made from the dust of the Earth like Adam. The story is that this is the reason why she was independent minded and as a result God made a new woman from the rib of man so that woman would be “from man” and more likely to be obedient to God and man. Not stating my opinion - that’s just what I read.