So was Ishmael and Esau, but they were not Children of Promise, of the election of Grace. Being born merely Physical descendants of Abraham, and thats all, then you are not the Children of God. Rom 9:
8That is, They which are the children of the flesh, these are not the children of God: but...