OAKES, Circuit Judge:
This case involves the issue whether section 503 of the Vocational Rehabilitation Act of 1973, as amended, 29 U.S.C. § 793,1 gives an employee a private right of action against an employer contracting with the federal government for alleged discrimination in employment on the basis of physical handicap. The question has been answered contrarily by a number of district courts,2 with differing views among the district judges in the Second Circuit,3 but the only courts of appeal passing on the question, the Fifth,4 Sixth,5 and Seventh,6 Circuits, have held that there is no such private judicial remedy. We agree with the extended analysis of this question by Judge Alvin Rubin for the panel majority in the Fifth Circuit in Rogers v. Frito-Lay, Inc., 611 F.2d 1074 (5th Cir. 1980), and our examination of the cases decided in the Supreme Court and in our own court since Rogers was handed down reenforces the conclusion in Rogers that no private right of action may be inferred from section 503. Accordingly, we reverse the judgment of the United States District Court for the Eastern District of New York, Jack B. Weinstein, Chief Judge, which found the reasoning of courts upholding a private right of action “persuasive” in light of the factors identified by the Supreme Court in Cort v. Ash, 422 U.S. 66, 95 S.Ct. 2080, 45 L.Ed.2d 26 (1975). We do not reach the question whether Thomas Davis, the appellee, had failed to exhaust his administrative reme[122]*122dies in this case, or the question whether this case was within the primary jurisdiction of the Department of Labor.
The facts as alleged in the complaint may be very briefly stated. Thomas Davis had worked for United Air Lines, Inc. (“United") since 1966 as a ramp serviceman, servicing aircraft and loading and unloading cargo. In 1969 he was diagnosed as having epilepsy and from time to time until mid-September 1974, he experienced seizures that did not interfere with his satisfactory performance of duties as a ramp serviceman. After he experienced a seizure in mid-September 1974, he was placed on restricted duties, and he was ultimately confined to working in the bag room. In June 1977, he was placed on “extended illness status” because of his epilepsy; he was officially discharged on February 15, 1980.
In December 1978 Davis filed a complaint with the Department of Labor as provided by section 503(b), note 1 supra, charging that United had discriminated against him on the basis of his physical handicap. The Department of Labor has not acted on his complaint. In October 1979, he filed a private suit against United in the Eastern District of New York claiming that United had violated his rights under section 503. Judge Weinstein denied United’s motion for judgment on the pleadings, and certified his order for appeal in accordance with 28 U.S.C. § 1292(b). It is assumed for purposes of this appeal that Davis is physically “handicapped” within the meaning of the Act, see 29 U.S.C. § 706(6), that United holds government contracts subject to the requirements of section 503, and that Davis was discharged because of his handicap.
The law may be briefly stated as follows. Under section 503(a), any contract in excess of $2,500 entered into by the federal government must “contain a provision requiring that ... [the contractor] shall take affirmative action to employ and advance in employment qualified handicapped individuals .... ” 29 U.S.C. § 793(a). Section 503(b) provides that if any handicapped individual “believes any contractor has failed or refuse[d] to comply with the provisions of his [federal] contract,” that “such individual may file a complaint with the Department of Labor” which shall “promptly investigate” and “take such action ... as the facts and circumstances warrant.... ”
Because section 503 creates no explicit private judicial remedy against federal contractors charged with employment discrimination against the handicapped, the federal courts have had to determine whether a private right of action may be inferred. The starting points for our analysis must be the four factors set out in Cort v. Ash, whether we view these factors as “a part of our law,” California v. Sierra Club, 451 U.S. 287, 301, 101 S.Ct. 1775, 1783, 68 L.Ed.2d 101 (1981) (Stevens, J., concurring), or as “merely guides in the central task of ascertaining legislative intent,” id. at 302, 101 S.Ct. at 1783 (Rehnquist, J., concurring in the judgment). See Texas Industries v. Radcliff Materials, Inc., 451 U.S. 630, 639, 101 S.Ct. 2061, 2066, 68 L.Ed.2d 500 (1981). Analysis of the Cort factors is the “preferred approach” for determining whether an implied private right of action exists. See Transamerica Mortgage Advisors v. Lewis, 444 U.S. 11, 26, 100 S.Ct. 242, 250, 62 L.Ed.2d 146 (1979) (White, J., dissenting); Cannon v. University of Chicago, 441 U.S. 677, 99 S.Ct. 1946, 60 L.Ed.2d 560 (1979).
Under Cort the initial consideration is whether the plaintiff is a member of a class for “whose especial benefit the statute was enacted.” Cort v. Ash, 422 U.S. at 78, 80-82, 95 S.Ct. at 2087, 2089. See Touche Ross & Co. v. Redington, 442 U.S. 560, 569-70, 99 S.Ct. 2479, 2484-85, 61 L.Ed.2d 82 (1979). Although section 503 was generally intended to benefit handicapped persons, that alone does not establish that Congress intended to “create a federal right in favor of the plaintiff.” Cort v. Ash, 442 U.S. at 78, 95 S.Ct. at 2088. See Rogers v. Frito-Lay, Inc., 611 F.2d at 1079.
The Supreme Court has suggested that a private right of action may be more readily implied when the language of a statute is “right-creating” rather than merely “duty-creating.” See Cannon v. University of [123]*123Chicago, 441 U.S. at 690 n. 13, 99 S.Ct. at 1954. Statutory language has been found right-creating when it focuses explicitly on the benefited class. See, e. g., id. at 682 n. 3, 99 S.Ct. at 2487 (“no person . .. shall, on the basis of sex, be excluded . . .,” 20 U.S.C. § 1681); Allen v. State Board of Elections, 393 U.S. 544, 554-55, 89 S.Ct. 817, 825-26, 22 L.Ed.2d 1 (1969) (“no person shall be denied the right to vote . . .,” 42 U.S.C. § 1973c).
Section 504 of the Vocational Rehabilitation Act of 1973, 29 U.S.C. § 794, which is not at issue in this case, invokes just such right-creating language: “No otherwise qualified handicapped individual . .. shall, solely by reason of his handicap, be excluded from the participation in, be denied the benefits of, or be subjected to discrimination under any program or activity receiving Federal financial assistance.” Accordingly, a number of courts have held that section 504 creates a private cause of action for handicapped persons.7
By contrast, section 503 contains only duty-creating language, directing federal departments and agencies to provide in all federal contracts that contractors are obligated to take affirmative steps to employ and advance handicapped persons. Nowhere does section 503 confer an express right upon the handicapped, nor impose a direct duty on federal contractors. See Rogers v. Frito-Lay, Inc., 611 F.2d at 1079-80. As Judge Rubin noted in Rogers, the use of duty-creating rather than right-creating phrases, though “not conclusive,” makes “inference of a private cause of action more difficult.” Id. at 1080. Indeed, the Supreme Court has stated that language such as that contained in section 503 militates against inferring a private right of action:
There would be far less reason to infer a private remedy in favor of individual persons if Congress, instead of drafting Title IX with an unmistakable focus on the benefited class, had written it simply as a ban on discriminatory conduct by recipients of federal funds or as a prohibition against the disbursement of public funds to educational institutions engaged in discriminatory practices.
Cannon v. University of Chicago, 441 U.S. at 690-93, 99 S.Ct. at 1954-55.
The second inquiry under Cort is whether there is any legislative history evidencing congressional intent to create or deny a private remedy. We read Cort and its progeny, including California v. Sierra Club, supra, and Universities Research Ass’n, Inc. v. Coutu, 450 U.S. 754, 101 S.Ct. 1451, 67 L.Ed.2d 662 (1981) (no private right of action under Davis-Bacon Act against private employers) as requiring a very close, even microscopic, examination of the legislative history of the particular statute involved. This reading of the legislative history must be done with an enlightened judicial eye, giving full attention to the underlying congressional purpose, the very heart of statutory analysis, see Cox, Judge Learned Hand and the Interpretation of Statutes, 60 Harv. L.Rev. 370, 374-75 (1947); Wyzanski, Judge Learned Hand’s Contributions to Public Law, 60 Harv.L.Rev. 348, 360-62 (1947); WATCH v. Harris, 603 F.2d 310 (2d Cir.), cert. denied, 444 U.S. 995, 100 S.Ct. 530, 62 L.Ed.2d 426 (1979), but also with a healthy skepticism of “casual statements from floor debates,” as Justice Jackson warned us so pointedly in Schwegmann Bros. v. Calvert Distillers Co., 341 U.S. 384, 396, 71 S.Ct. 745, 751, 95 L.Ed. 1035 (1951).
Taking such a yiew of section 503, we find nothing in the history of the original Rehabilitation Act of 1973 that easts any light on whether Congress intended to create a private right of action. Given Congress’s initial silence, we may seek some guidance from the 1974 and 1978 amend[124]*124ments to the Act. In giving weight to these amendments, we would choose a middle road between the panel majority in Rogers v. Frito-Lay, Inc., 611 F.2d at 1080 (“[Wjhat happened after a statute was enacted may be history and it may come from members of the Congress, but it is not part of the legislative history of the original enactment”), and Judge Goldberg’s dissent in Rogers, 611 F.2d at 1100 (“it is a well-established principle that the post-enactment treatment of a statute by Congress is cogent evidence of the intent of Congress at the time of its passage”). We believe our view is called for by Cannon v. University of Chicago, 441 U.S. at 686-87 n. 7, 99 S.Ct. at 1952-53 n. 7, in which the Court, while partially relying on subsequent legislative history, noted that “we cannot accord these remarks the weight of contemporary legislative history. ...” See WATCH v. Harris, 603 F.2d at 324-25; North Haven Board of Education v. Hufstedler, 629 F.2d 773, 783-85 (2d Cir. 1980), cert. granted, 450 U.S. 909, 101 S.Ct. 1345, 67 L.Ed.2d 332 (U.S.1981).
The subsequent legislative history of the Rehabilitation Act is internally conflicting. The 1974 amendments deal expressly with section 504, equating it with Title VI (42 U.S.C. § 2000d-l) (race discrimination) and Title IX (42 U.S.C. § 1683) (sex discrimination). Senate Report No. 93-1297, which urged overriding the President’s veto of the 1974 amendments, expressly noted that section 504 permits a private right of action. See 1974 U.S.Code Cong. & Ad.News 6373, 6390.
In contrast, the Senate Conference Committee never explicitly stated that section 503 confers a. private right of action. Although the report did state that “[i]t is intended that sections 503 and 504 be administered in such a manner that a consistent, uniform and effective Federal approach to discrimination against handicapped persons would result,” id. at 6391, this appears to refer simply to the desirability of cooperation between the Department of Health, Education, and Welfare, which was assigned to enforce section 504, and the Department of Labor, which was assigned to enforce section 503. This separate assignment may even indicate that section 503, unlike 504, was not intended to be privately enforced; the Department of Labor, unlike the Department of Health, Education, and Welfare, lacked experience in dealing with private lawsuits. See Rogers v. Frito-Lay, Inc., 611 F.2d at 1081 n. 7.
The only indication that a “uniform” approach to combatting employment discrimination against the handicapped might entail a private right of action under section 503 as well as section 504 is the remarks of a senator who was not a member of the conference committee, although he was one of the principal sponsors of the original Act and its subsequent amendments. Senator Robert Stafford of Vermont stated on the floor in 1974 that enforcement under both sections 503 and 504 should be similar to enforcement under Title VI and Title IX. 120 Cong.Rec. 30551 (1974). These remarks were not, however, included in the conference committee report. Furthermore, although an exchange of correspondence between the Senate Committee on Labor and Public Welfare and the Secretary of Labor regarding the enforcement of section 503 is appended to the report, nowhere in that correspondence is there any hint that the statute was to be enforced through private lawsuits. See, e. g., 1974 U.S.Code Cong. & Ad.News 6425, 6429, 6430, 6438, 6439-40. The only portion of the exchange between Committee and Department dealing with complaints relates to the Department’s taking “primary responsibility for enforcement of complaints” and the Senate Committee’s concern that “there is too much emphasis given to the contracting agency’s internal resolution of such complaints because there is no standard established in the [Labor Department’s] regulations as to what is an effective or accepted internal review procedure.” Id. at 6429.
With the exception of Senator Stafford’s statement on the floor, then, the legislative intent demonstrated by the history of the 1974 amendments simply does not support implication of a private right of action under section 503. In 1978, however, when Congress again amended the Act by adding [125]*125section 505 to provide for attorney’s fees “[i]n any action or proceeding to enforce or charge a violation of [the Act],” 29 U.S.C. § 794a, the accompanying Senate Report clearly assumed that a private judicial remedy was available under section 503: “[T]he availability of attorney’s fees should assist in vindicating private rights of action in the case of section 502 and 503 cases, as well as those arising under section 501 and 504.” S.Rep.No. 890, 95th Cong., 2d Sess. 19 (1978) (Human Resources Committee). H.R. Rep.No. 95-1149, 95th Cong., 2d Sess. 21 (1978) (Education and Labor Committee), reprinted in 1978 U.S.Code Cong. & Ad. News 7312, 7332, spoke in exactly the same terms.8
Neither the Senate nor the House Reports, however, contained any reference to the existing case law from the district courts. Although two district court cases had found that there was a private right of action under section 503, Duran v. City of Tampa, 430 F.Supp. 75 (M.D.Fla.1977); Drennon v. Philadelphia General Hospital, 428 F.Supp. 809 (E.D.Pa.1977), three cases had held that no implied right of action existed, Wood v. Diamond State Telephone Co., 440 F.Supp. 1003 (D.Del.1977); Moon v. Roadway Express, Inc., 439 F.Supp. 1308 (N.D.Ga.1977), aff’d, Rogers v. Frito-Lay, Inc., 611 F.2d 1074 (5th Cir. 1980); Rogers v. Frito-Lay, Inc., 433 F.Supp. 200 (N.D. Tex.1977), aff’d, 611 F.2d 1074 (5th Cir. 1980).
This failure to note the conflicting case law of the time indicates that the reference to private rights of action being available in section 502 and 503 cases as well as those arising under sections 501 and 504 was inadvertent. This seems especially true in light of the Senate Report’s extensive reference to the testimony of Deborah Kaplan of the Disability Rights Center before the Subcommittee on the Handicapped, S.Rep.No. 890, supra, at 18-20. Her testimony quoted in the Senate Report related only to sections 501 and 504:
Unfortunately, the disabled citizens who are protected by section 501 as well as section 5Ó4 stand alone among minority groups in this country, since they remain largely unaffected by the recently enacted Civil Rights Attorney’s Fees Awards Act of 1976, Public Law 94-559, and because the legislation which protects their civil rights contains no attorney’s fees provision. Thus many disabled people, who desperately need to vindicate their rights through the courts, have been utterly frustrated and disillusioned because they could neither afford an attorney, locate one able to represent them without a fee, nor seek an attorney’s fee award from the courts.
Id. at 19. We note also the Seventh Circuit’s point in Simpson v. Reynolds Metals Co., 629 F.2d 1226, 1242 (7th Cir. 1980), that allowing attorney’s fees in actions or proceedings brought under section 503 may have been intended to provide for attorney’s fees either in a section 503(b) proceeding before the Department of Labor or in a judicial proceeding brought pursuant to the Department of Labor’s regulations permitting the director of the Office of Federal Contract Compliance Programs (OFCCP) to seek appropriate judicial action to enforce the affirmative action contractual provisions required under the Act. See 41 C.F.R. § 60-741.28(b) (1980).9 In short, even giving appropriate weight to the subsequent legislative history reflected in the 1978 amendment, we find nothing that compels us to the conclusion that a private right of action exists under section 503. The assumption in the 1978 congressional reports [126]*126simply “cannot be relied upon as a faithful indicator of prior congressional intent.” Simpson v. Reynolds Metals Co., 629 F.2d at 1243.
Given the somewhat ambiguous legislative history, however, we must proceed to the third question under Cort v. Ash: whether it is consistent with the underlying purposes of the legislative scheme to infer a private right of action for the handicapped person discriminated against by his employer. Here we note, as did the Rogers majority, 611 F.2d at 1084, that Congress provided a rather complete administrative scheme to remedy section 503 violations and that the implementing regulations, 41 C.F.R. §§ 60-741.4 to 60-741.54 (1980), emphasize resolving complaints to the Department of Labor “by informal means, including conciliation, and persuasion, whenever possible,” id. § 60-741.28(a). The regulations provide as remedies withholding of progress payments, termination of existing contracts, or debarment from receiving future contracts, id. § 60-741.28(c) to (e), rather than remedies running to the discriminated-against employee. In this regard, the administrative procedures established by the Act and implementing regulations are remarkably consistent with those under the Comprehensive Employment and Training Act (CETA) discussed in CETA Workers’ Organizing Committee v. New York, 617 F.2d 926 (2d Cir. 1980). Although the scheme for implementation of the CETA provided in CETA § 106, 29 U.S.C. § 816, may be somewhat more sophisticated than that provided for by section 503 of the Rehabilitation Act— the Rehabilitation Act regulations contain no deadlines for the processing of complaints, 41 C.F.R. § 60-741.26(e) (1980) — we cannot find this distinction between the cases very significant. Rather, as in CETA Workers, 617 F.2d at 933-34, we believe that the underlying congressional purpose was to provide an administrative procedure for the determination of complaints under which the administering agency was to use its powers to enforce the section in question. See Middlesex County Sewerage Authority v. National Sea Clammers Ass’n, -U.S.-,-, 101 S.Ct. 2615, 2623, 69 L.Ed.2d 435 (1981); Transamerica Mortgage Advisors, 444 U.S. at 19, 100 S.Ct. at 247. And though the Rehabilitation Act failed directly to provide for judicial review of such an administrative procedure, the Department of Labor evidently thought that such review might be possible, as indicated by regulation section 60-741.28(b). The implementing regulations do incorporate the elaborate and sophisticated hearing practice and procedure used to enforce equal opportunity under Executive Order No. 11,246, reprinted in 41 C.F.R. part 60-30, see 41 C.F.R. § 60-741.29(b) (1980); these elaborate hearing provisions culminate, or may culminate, in a final administrative order, id. § 60-30.37, which is in our view reviewable like other administrative orders under the Administrative Procedure Act and particularly 5 U.S.C. §§ 701-706.
To be sure, the regulations’ failure to specify time limits has presented a problem that is particularly evident in the case at bar. The Department of Labor has, contrary to the will of Congress, been unable to comply speedily with the provisions of the Rehabilitation Act. This has resulted in the Department’s taking the position in the past, although it takes no position here, that a private cause of action should be permitted in order to remedy section 503 violations more effectively and indeed an acknowledgment that “[t]he net effect of [OFCCP] discretion is that there is no assurance that compliance decisions are not tempered by political, procurement, personal or other potentially competing or conflicting requirements,” OFCCP Task Force, Preliminary Report on the Revitalization of the Federal Contract Compliance Program (1977), quoted in Rogers v. Frito-Lay, Inc., 611 F.2d at 1106 (Goldberg, J., dissenting). The agency backlog and its position in favor of recognition of a private remedy are set forth in an affidavit by the director of the OFCCP, quoted in an appendix to the Rogers opinion, 611 F.2d at 1108-09, and submitted in an amicus brief to Judge Lasker in Chaplin v. Consolidated Edison Co. of New York, Inc., 482 F.Supp. 1165, 1172 (S.D.N.Y.1980). While lack of executive resources to enforce [127]*127an act of Congress is regrettable, it is hardly the judiciary’s role to redress that lack by inferring a judicial remedy. See Piper v. Chris-Craft Industries, 430 U.S. 1, 41, 97 S.Ct. 926, 949, 51 L.Ed.2d 124 (1977); Riegel Textile Corp. v. Celanese Corp., 649 F.2d 894, 904-05 (2d Cir. 1981).
Moreover, although a department’s position on whether an implied private cause of action exists is entitled to judicial consideration, see Cannon, 441 U.S. at 686-88, 99 S.Ct. at 1952-53, of. North Haven Board of Education, 629 F.2d at 777 (a court should “give due weight to the contemporaneous construction of a statute by the agency charged with its administration”), an agency’s expertise, “[ejven if the agency spoke with a consistent voice, ... is of limited value when the narrow legal issue is one peculiarly reserved for judicial resolution, namely whether a cause of action should be implied by judicial interpretation in favor of a particular class of litigants.” 1Piper v. Chris-Craft Industries, 430 U.S. at 41 n. 27, 97 S.Ct. at 949. See Riegel Textile Corp. v. Celanese Corp., 649 F.2d at 897 n. 4. As Judge Learned Hand stated:
[I]t is doubtful whether in the end one can say more than that there comes a point at which the courts must form their own conclusions. Before doing so they will, of course — like the administrative tribunals themselves — look for light from every quarter, and after all crannies have been searched, will yield to the administrative interpretation in all doubtful cases; but they can never abdicate.
Niagara Falls Power Co. v. FPC, 137 F.2d 787, 792 (2d Cir.), cert. denied, 320 U.S. 792, 64 S.Ct. 206, 88 L.Ed. 477 (1943).
In any case, an after-the-fact acknowledgment of inadequacy because of limited departmental resources is not the equivalent of a long-held, firmly established, well-reasoned position that the agency has made known to Congress and to the courts over the years, such as in Cannon, 441 U.S. at 688 n. 8, 99 S.Ct. at 1952-53, or in North Haven Board of Education, 629 F.2d at 783-84. Indeed, the record here contains no such similar statement by the agency. Cf. Simpson v. Reynolds Metals Co., 629 F.2d at 1244 (discussing the OFCCP’s representation of inadequacy in Rogers and Chaplin but noting the absence of any such representation in the record in that case).
We need not deal with the fourth Cort v. Ash factor; it is plain enough that discrimination against the disabled has not been a matter traditionally relegated to state law. But we conclude, as have the other three courts of appeals that have passed upon the question, that no implied private right of action exists under section 503, recognizing that the glass through which we see is by no means crystal clear but is so cloudy as to be barely translucent.
Judgment reversed.