If the brake fluid dissolves that black silicone (RTV) you will have either dissolved bits of RTV all throughout your brake lines and wheel cylinders, or at least have contaminated fluid. I do not think it's a very good idea to use something like that in this area!